-- Logs begin at Wed 2022-05-04 18:05:58 UTC, end at Wed 2022-05-04 19:24:48 UTC. -- May 04 18:57:23.230649 dv-cinder-830901-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 04 18:57:23.240435 dv-cinder-830901-3-iscsi devstack@n-api.service[102746]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 04 18:57:23.241837 dv-cinder-830901-3-iscsi devstack@n-api.service[102746]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 4 18:57:23 2022] *** May 04 18:57:23.241837 dv-cinder-830901-3-iscsi devstack@n-api.service[102746]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 04 18:57:23.241837 dv-cinder-830901-3-iscsi devstack@n-api.service[102746]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 04 18:57:23.241837 dv-cinder-830901-3-iscsi devstack@n-api.service[102746]: nodename: dv-cinder-830901-3-iscsi May 04 18:57:23.241837 dv-cinder-830901-3-iscsi devstack@n-api.service[102746]: machine: x86_64 May 04 18:57:23.241837 dv-cinder-830901-3-iscsi devstack@n-api.service[102746]: clock source: unix May 04 18:57:23.241837 dv-cinder-830901-3-iscsi devstack@n-api.service[102746]: pcre jit disabled May 04 18:57:23.241837 dv-cinder-830901-3-iscsi devstack@n-api.service[102746]: detected number of CPU cores: 4 May 04 18:57:23.241837 dv-cinder-830901-3-iscsi devstack@n-api.service[102746]: current working directory: / May 04 18:57:23.241837 dv-cinder-830901-3-iscsi devstack@n-api.service[102746]: detected binary path: /usr/bin/uwsgi-core May 04 18:57:23.241837 dv-cinder-830901-3-iscsi devstack@n-api.service[102746]: your processes number limit is 47680 May 04 18:57:23.241837 dv-cinder-830901-3-iscsi devstack@n-api.service[102746]: your memory page size is 4096 bytes May 04 18:57:23.241837 dv-cinder-830901-3-iscsi devstack@n-api.service[102746]: detected max file descriptor number: 2048 May 04 18:57:23.242636 dv-cinder-830901-3-iscsi devstack@n-api.service[102746]: lock engine: pthread robust mutexes May 04 18:57:23.242636 dv-cinder-830901-3-iscsi devstack@n-api.service[102746]: thunder lock: enabled May 04 18:57:23.242636 dv-cinder-830901-3-iscsi devstack@n-api.service[102746]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 04 18:57:23.242636 dv-cinder-830901-3-iscsi devstack@n-api.service[102746]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 04 18:57:23.288585 dv-cinder-830901-3-iscsi devstack@n-api.service[102746]: Python main interpreter initialized at 0x557ec03219c0 May 04 18:57:23.288585 dv-cinder-830901-3-iscsi devstack@n-api.service[102746]: python threads support enabled May 04 18:57:23.288585 dv-cinder-830901-3-iscsi devstack@n-api.service[102746]: your server socket listen backlog is limited to 100 connections May 04 18:57:23.288585 dv-cinder-830901-3-iscsi devstack@n-api.service[102746]: your mercy for graceful operations on workers is 90 seconds May 04 18:57:23.288964 dv-cinder-830901-3-iscsi devstack@n-api.service[102746]: mapped 403077 bytes (393 KB) for 2 cores May 04 18:57:23.289043 dv-cinder-830901-3-iscsi devstack@n-api.service[102746]: *** Operational MODE: preforking *** May 04 18:57:23.289255 dv-cinder-830901-3-iscsi devstack@n-api.service[102746]: *** uWSGI is running in multiple interpreter mode *** May 04 18:57:23.289255 dv-cinder-830901-3-iscsi devstack@n-api.service[102746]: spawned uWSGI master process (pid: 102746) May 04 18:57:23.289454 dv-cinder-830901-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 04 18:57:23.293811 dv-cinder-830901-3-iscsi devstack@n-api.service[102746]: spawned uWSGI worker 1 (pid: 102747, cores: 1) May 04 18:57:23.293811 dv-cinder-830901-3-iscsi devstack@n-api.service[102746]: spawned uWSGI worker 2 (pid: 102748, cores: 1) May 04 18:57:23.293811 dv-cinder-830901-3-iscsi devstack@n-api.service[102746]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 04 18:57:24.483250 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 04 18:57:24.485679 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 04 18:57:25.209768 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 04 18:57:25.209768 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: from cryptography.utils import int_from_bytes May 04 18:57:25.210091 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 04 18:57:25.210091 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: from cryptography.utils import int_from_bytes May 04 18:57:25.210997 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 04 18:57:25.210997 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: from cryptography.utils import int_from_bytes May 04 18:57:25.211322 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 04 18:57:25.211322 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: from cryptography.utils import int_from_bytes May 04 18:57:27.819918 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 04 18:57:27.820612 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 04 18:57:27.820719 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 04 18:57:27.821050 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 04 18:57:27.821309 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 04 18:57:27.821726 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.822060 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.822387 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.822713 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.823047 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.823362 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.823686 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.824009 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.824901 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.825163 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.825497 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.825833 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-830901-3-iscsi {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.826093 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 04 18:57:27.826449 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.826536 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 04 18:57:27.826622 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.826764 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.826862 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 04 18:57:27.827090 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.827219 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 04 18:57:27.827400 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.827491 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 04 18:57:27.827728 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.827860 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.828039 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.828190 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.828514 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.828605 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.828837 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.828995 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.829170 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.829311 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.829498 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.829667 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.829841 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.830022 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.830223 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.830420 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.830607 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.830805 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.830989 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.831188 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.831372 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.831563 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.831753 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-830901-3-iscsi {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.831952 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.832141 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.832326 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.832523 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.832718 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-830901-3-iscsi {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.832903 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.833096 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.833289 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.833289 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.833636 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.833847 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.834037 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.834232 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.834425 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.834425 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.834774 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.834949 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.835118 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.835250 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.835382 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.835542 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.835667 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.835795 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.835944 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.836074 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.836244 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.836517 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.836659 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.836783 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.836936 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.837079 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.837213 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.837343 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.837497 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.837660 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.837794 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.837930 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.838057 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-830901-3-iscsi {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.838180 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.838311 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.838451 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.838583 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.838716 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.838839 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.838961 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.838961 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.839204 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.839341 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.839465 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.839599 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.839733 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.839868 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.840006 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.840131 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.840305 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.840435 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.840640 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.840767 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.840900 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.841034 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.841157 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.841286 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.841451 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.841605 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.841737 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.841861 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.841989 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.842118 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.842252 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.842384 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.842507 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.842629 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.842809 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.842945 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.843119 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.843258 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.843427 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.843561 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.843685 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.843850 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.843985 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.844180 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.844313 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.844493 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.844625 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.844818 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.844952 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.845149 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.845275 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.69 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.845397 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.845567 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.69 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.845737 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.845866 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.846063 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.846191 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.846377 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.846529 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.846725 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.846853 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.846987 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.847118 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.847284 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.847424 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.847601 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.847734 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.847911 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.848050 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.848223 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.848360 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.848533 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.848675 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.848855 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.848992 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.849157 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.849280 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.849413 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.849553 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.849737 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.849866 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.850053 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.850183 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.850378 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.850546 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.69 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.850678 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.850806 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.69 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.850990 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.851117 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.851302 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.851427 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.851607 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.851740 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.851918 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.852050 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.852229 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.852361 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.852540 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.852677 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.852853 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.852986 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.853165 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.853298 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.853521 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.853668 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.853792 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.853912 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.854105 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.854232 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.854415 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.854550 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.854672 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.854802 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.855127 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.855253 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.855358 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.855491 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.855628 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.855752 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.855909 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.856057 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.856212 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.856354 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.856519 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.856655 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.856859 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.856993 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.857117 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.857249 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.857423 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.857572 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.857758 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.857885 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.858072 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.858210 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.858385 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.858513 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.858692 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.858831 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.859003 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.859142 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.859314 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.859443 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.859621 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.859748 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.859930 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.860056 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.860252 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.860378 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.860563 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.860689 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.860869 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.861002 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.861176 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.861309 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.861508 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.861641 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.861813 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.861941 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.862123 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.862249 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.862431 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.862564 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.862738 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.862865 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.863044 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.863177 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.863351 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.863484 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.863673 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.863802 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.863984 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.864118 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.864294 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.864427 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.864605 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.864735 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.864909 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.865043 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.865220 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.865356 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.865568 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.865705 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.865863 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.865990 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.866172 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.866312 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.866480 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.866608 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.866788 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.867000 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.867203 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.867329 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.867457 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.867581 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.867710 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.867833 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.867966 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.868150 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.868283 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.868470 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.868597 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.868789 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.868930 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.869108 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.869235 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.869438 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.869607 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.869787 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.869922 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.870111 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 18:57:27.870258 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.870464 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.870590 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.870749 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.870884 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.871586 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.871714 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.871905 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.872023 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.872230 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.872364 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.872565 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.872703 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.872930 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.873097 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.873232 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.873365 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.873527 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.873655 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.873846 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.873974 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.874164 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.874299 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.874484 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.874611 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.874800 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.874935 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.875124 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.875254 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.875455 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.875580 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.875740 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.875875 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.876069 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.876198 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.876389 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.876515 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.876712 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.876854 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.877059 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.877200 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.877340 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.877510 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.877671 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.877813 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.877990 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.878117 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.878307 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.878435 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.878624 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.878760 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.878967 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.879095 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.879284 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.879411 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.879602 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.879741 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.879923 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.880049 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.880241 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.880368 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.880556 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.880697 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.880870 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.881003 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.881188 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.881316 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.881532 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.881668 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.881847 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.881984 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.882158 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.882293 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.882472 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.882600 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.882780 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.882904 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.883092 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.883219 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.883407 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.883538 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.883721 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.883848 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.884057 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.884190 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.884370 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.884498 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.884686 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.884813 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.885000 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.885139 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.885316 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.885570 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.885703 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.885826 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.885948 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.886084 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.886255 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.886390 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.886563 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.887379 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.887516 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.887653 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.887790 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.887915 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.888053 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.888177 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.888326 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.888463 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.888650 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.888777 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.888964 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.889090 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.889278 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.889406 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.889618 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.889753 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.889934 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.890061 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.890251 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.890379 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.890567 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.890699 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.890877 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.890995 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.891198 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.891324 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.891490 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.891617 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.891803 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.891930 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.892112 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.892234 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.892439 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.892573 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.892753 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.892893 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.893061 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.893195 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.893388 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.893554 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.893724 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.893858 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.894032 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.894160 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.894603 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.894735 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.894916 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.895052 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.895228 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.895356 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.895544 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.895669 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.895852 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.895987 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.896162 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.896297 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.896471 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.896598 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.896780 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.896908 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.897089 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.897218 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.897423 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.897607 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.897758 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.897891 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.898065 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.898197 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.898375 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.898510 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.898683 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.898812 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.899002 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.899128 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.899315 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.899450 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.899622 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.899759 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.899929 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.900055 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.900237 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.900374 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.900549 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.900686 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.900855 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.900982 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.901161 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.901301 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.901497 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.901638 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.901791 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.901919 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.902096 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.902273 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.902463 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.902591 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.902776 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.902902 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.903084 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.903224 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.903391 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.903526 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.903696 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.903822 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.904039 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.904168 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.904348 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.904483 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.904680 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.904805 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.904992 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.905120 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.905314 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.905440 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.905669 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.905797 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.905989 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.906118 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.906309 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.906436 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.906625 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.906753 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.906940 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.907066 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.907253 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.907379 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.907570 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.907680 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.907888 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.907988 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.908204 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.908310 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.908517 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.908627 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.908829 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.908932 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.909142 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.909237 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.909453 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.909579 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.909794 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.909901 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.910102 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.910213 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.910420 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.910529 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.910739 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.910826 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.911049 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.911152 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.911371 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.911480 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.911701 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.911787 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.912014 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.912102 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.912333 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.912437 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.912646 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.912743 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.912958 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.913045 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.913272 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.913359 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.913607 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.913696 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.913925 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.914013 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.914236 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.914331 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.914548 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.914637 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.914857 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.914951 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.915177 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.915264 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.915486 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.915572 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.915801 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.915900 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.916106 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.916193 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.916422 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.916510 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.916733 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.916831 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.917043 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.917130 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.917352 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.917440 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.917690 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.917789 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.918042 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.918129 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.918355 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.918450 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.918667 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.918764 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.918981 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.919068 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.919290 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.919385 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.919598 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.919693 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.919909 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.919996 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.920228 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.920313 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.920537 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.920634 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.920844 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.920932 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.921151 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.921238 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.921486 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.921578 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.921796 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.921883 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.922103 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.922192 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.922407 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.922503 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.922721 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.922817 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.923042 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.923128 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.923354 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.923450 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.923669 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.923762 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.923988 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.924083 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.924291 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.924378 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.924597 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.924693 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.924922 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.925018 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.925233 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.925321 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.925560 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.925651 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.925867 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.925971 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.926174 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.926263 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.926501 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.926594 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.926819 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.926915 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.927125 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.927212 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.927438 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.927525 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.927749 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.927883 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.928065 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.928152 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.928384 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.928470 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.928699 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.928953 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.929040 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.929292 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.929378 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.929655 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.929757 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.929970 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.930058 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.930282 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.930375 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.930598 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.930700 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.930913 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.931011 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.931226 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.931322 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.931553 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.931641 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.931866 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.931964 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.932180 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.932274 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.932491 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.932588 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.932798 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.932896 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.933111 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.933198 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.933420 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.934136 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.934267 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.934533 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.934622 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.934870 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.934957 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.935178 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.935277 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.935489 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.935577 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.935798 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.935885 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.936107 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.936197 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.936426 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.936520 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.936736 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.936832 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.937056 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.937146 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.937367 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.937486 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.937709 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.937797 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.938019 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.938123 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.938325 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.938419 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.938634 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.938729 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.938942 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.939030 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.939252 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.939338 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.939560 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.939657 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.939873 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.939962 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.940181 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.940268 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.940490 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.940630 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.940797 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.940887 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.941105 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.941193 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.941423 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.941552 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.941752 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.941844 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.942067 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.942155 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.942375 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.942476 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.942690 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.942811 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.943002 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.943097 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.943308 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.943404 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.943613 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.943707 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.943919 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.944006 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.944231 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.944326 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.944546 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.944633 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.944853 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.944939 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.945165 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.945326 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.945488 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.945591 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.945819 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.945907 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.946134 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.946224 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.946445 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.946533 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.946754 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.946841 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.947061 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.947149 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.947367 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.947456 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.947675 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.947760 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.947985 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.948072 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.948289 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.948376 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.948606 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.948693 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.948915 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.949002 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.949786 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.949885 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.950099 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.950200 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.950404 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.950490 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.950715 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.950802 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.951021 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.951118 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.951339 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.951426 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.951651 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.951779 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.951958 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.952055 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.952261 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.952367 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.952572 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.952662 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.952879 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.952973 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.953183 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.953276 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.953516 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.953605 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.953825 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.953921 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.954144 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.954231 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.954450 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.954537 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.954755 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.954852 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.955059 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.955147 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.955370 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.955454 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.955679 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.955766 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.955985 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.956109 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.956292 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.956380 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.956603 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.956698 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.956908 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.956996 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.957213 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.957348 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.957545 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.957663 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.957856 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.957970 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.958165 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.958333 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.958480 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.958600 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.958792 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.958908 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.959104 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.959229 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.959410 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.959534 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.959725 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.959841 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.960033 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.960159 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.960342 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.960458 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.960650 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.960765 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.960962 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.961079 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.961268 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.961383 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.961612 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.961731 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.961921 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.962038 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.962230 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.962348 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.962537 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.962629 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.962865 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.962953 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.963177 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.963266 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.963486 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.963586 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.963793 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.963881 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.964100 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.964186 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.964421 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.964516 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.964762 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.964849 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.965091 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.965178 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.965418 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.965537 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.965758 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.965846 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.966070 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.966156 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.966386 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.966483 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.966701 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.966788 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.967012 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.967097 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.967319 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.967415 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.967632 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.967726 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.967943 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.968031 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.968257 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.968354 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.968571 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.968660 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.968877 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.968966 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.969191 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.969278 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.969527 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.969641 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.969848 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.969937 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.970163 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.970264 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.970518 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.970627 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.970806 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.970894 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.971112 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.971211 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.971420 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.971510 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.971733 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.971824 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.972041 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.972132 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.972545 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.972641 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.972641 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.972773 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.972983 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.973069 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.973313 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.973403 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.973710 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.973815 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.974520 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.974607 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.974697 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.974778 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.974932 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.975014 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.975014 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.975155 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.975233 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.975311 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.975530 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.975628 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.975860 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.975958 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.976175 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.976280 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.976476 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.976572 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.976789 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.976884 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.977096 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.977202 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.977411 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.977540 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.977744 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.977841 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.978089 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.978195 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.978399 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.978501 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.978708 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.978802 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.979019 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.979124 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.979349 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.979452 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.979659 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.979755 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.979986 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.980083 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.980300 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.980923 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.981115 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.981243 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.981558 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.981653 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.981875 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.981988 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.982190 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.982307 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.982504 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.982632 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.982813 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.982937 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.983119 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.983265 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.983432 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.983595 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.983758 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.983904 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.984065 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.984222 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.984373 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.984537 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.984679 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.984868 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.985006 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.985196 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.985314 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.985534 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.985661 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.985858 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.986081 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.986182 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.986398 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.986506 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.986708 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.986798 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.987103 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.987189 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.987429 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.987525 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.987741 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.987850 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.988066 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.988182 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.988391 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.988490 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.988719 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.988807 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.989031 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.989119 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.989346 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.989435 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.989683 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.989785 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.990010 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.990098 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.990336 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.990432 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.990648 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.990735 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.990965 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.991054 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.991274 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.991363 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.991589 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.991675 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.991904 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.991991 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.992218 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.992306 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.992527 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.992622 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.992836 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.992943 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.993164 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.993251 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.993504 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.993640 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.993825 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.993927 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.994144 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.994232 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.994473 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.994573 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.994800 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.994898 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.995109 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.995204 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.995416 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.995504 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.995725 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.995826 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.996592 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.996690 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.996905 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.997004 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.997221 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.997310 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.997562 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.997679 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.997881 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.997999 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.998213 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.998327 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.998492 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.998591 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.998819 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.998914 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.999131 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.999227 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.999457 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.999566 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.999774 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:27.999870 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.000102 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.000199 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.000421 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.000515 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.000729 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.000838 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.001055 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.001164 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.001365 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.001483 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.001695 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.001802 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.002003 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.002098 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.002313 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.002409 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.002624 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.002879 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.002977 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.003057 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.003235 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.003331 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.003544 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.003662 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.003853 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.003958 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.004180 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.004277 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.004490 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.004587 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.004818 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.004915 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.005131 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.005219 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.005441 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.005552 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.005776 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.005863 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.006082 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.006168 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.006391 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.006481 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.006707 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.006794 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.007017 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.007113 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.007326 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.007416 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.007635 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.007722 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.007945 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.008049 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.008249 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.008337 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.008555 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.008643 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.008864 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.008960 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.009189 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.009276 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.009514 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.009606 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.009841 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.009947 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.010154 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.010242 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.010461 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.010549 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.010770 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.010868 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.011077 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.011164 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.011404 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.011492 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.011737 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.011825 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.012061 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.012147 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.012386 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.012605 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.012704 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.012948 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.013048 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.013272 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.013359 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.013617 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.013729 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.013940 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.014027 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.014261 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.014358 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.014581 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.014679 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.014896 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.014982 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.015211 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.015299 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.015526 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.015615 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.015839 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.015926 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.016153 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.016242 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.016470 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.016560 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.016787 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.016874 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.017106 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.017200 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.017456 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.017666 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.017807 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.018003 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.018128 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.018324 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.018448 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.018643 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.018812 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.018964 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.019134 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.019551 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.019722 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.019872 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.020042 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.020188 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.020364 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.020502 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.020685 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.020817 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.021008 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.021130 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.021324 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.021488 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.021671 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.021806 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.021992 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.022137 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.022310 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.022476 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.022627 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.022795 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.022946 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.023165 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.023257 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.023419 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.023583 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.023735 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.023924 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.024094 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.024252 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.024413 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.024572 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.024724 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.024892 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.025041 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.025210 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.025359 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.025699 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.025790 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.026016 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.026106 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.026329 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.026417 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.026647 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.026736 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.026963 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.027052 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.027304 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.027392 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.027619 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.027708 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.027935 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.028024 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.028251 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.028338 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.028582 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.028678 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.028912 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.029005 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.029229 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.029317 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.029563 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.029670 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.029882 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.029969 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.030197 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.030285 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.030509 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.030724 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.030837 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.031046 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.031158 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.031385 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.031704 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.031803 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.032035 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.032122 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.032354 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.032441 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.032674 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.032763 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.033003 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.033088 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.033312 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.033409 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.033646 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.033737 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.033963 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.034058 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.034276 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.034369 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.034584 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.034672 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.034904 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.034989 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.035217 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.035303 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.035527 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.035613 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.035839 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.035965 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.036151 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.036248 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.036465 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.036692 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.036789 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.037044 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.037131 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.037364 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.037514 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.037720 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.037811 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.038031 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.038118 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.038345 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.038440 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.038657 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.038744 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.038974 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.039073 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.039287 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.039376 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.039596 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.039684 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.039904 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.039999 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.040215 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.040304 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.040522 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.040608 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.040829 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.040928 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.041141 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.041228 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.041450 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.041569 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.041782 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.041879 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.042091 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.042177 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.042398 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.042486 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.042730 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.043326 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.043551 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.043644 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.043862 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.043950 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.044173 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.044306 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.044490 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.044585 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.044795 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.044883 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.045104 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.045194 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.045414 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.045549 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.045747 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.045835 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.046061 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.046162 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.046368 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.046464 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.046679 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.046941 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.047038 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.047283 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.047371 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.047587 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.047682 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.047897 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.047987 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.048259 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.048347 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.048570 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.048656 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.048883 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.048973 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.049186 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.049273 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.049529 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.049620 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.049844 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.049934 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.050160 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.050255 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.050473 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.050568 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.050786 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.050875 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.051099 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.051185 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.051418 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.051514 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.051741 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.051974 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.052063 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.052314 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.052409 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.052637 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.052726 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.052968 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.053054 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.053286 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.053373 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.053628 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.053729 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.053938 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.054035 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.054250 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.054386 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.054577 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.054666 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.054892 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.054980 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.055207 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.055305 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.055520 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.055608 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.055833 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.055921 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.056150 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.056280 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.056462 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.056569 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.056772 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.056868 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.057087 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.057185 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.057401 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.057528 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.057739 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.057845 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.058052 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.058155 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.058367 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.058520 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.059243 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.059343 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.059593 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.059702 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.059915 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.060011 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.060238 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.060349 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.060556 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.060652 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.060870 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.060964 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.061182 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.061352 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.061517 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.061614 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.061831 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.061927 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.062145 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.062253 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.062463 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.062567 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.062796 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.062893 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.063112 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.063208 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.063421 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.063524 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.063754 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.063846 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.064034 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.064130 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.064373 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.064482 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.064677 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.064780 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.064988 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.065085 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.065297 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.065392 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.065638 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.065728 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.065950 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.066039 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.066261 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.066350 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.066572 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.066670 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.066882 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.066969 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.067196 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.067283 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.067504 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.067600 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.067815 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.067902 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.068125 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.068220 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.068446 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.068551 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.068757 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.068844 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.069065 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.069160 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.069379 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.069499 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.069715 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.069802 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.070069 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.070163 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.070328 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.070417 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.070633 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.070718 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.070937 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.071036 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.071247 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.071337 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.071553 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.071640 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.071859 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.071954 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.072173 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.072265 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.072479 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.072566 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.072785 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.072886 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.073093 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.073184 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.073401 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.073508 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.073732 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.073882 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.074040 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.074130 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.074394 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.074481 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.074701 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.074843 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.075076 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.075218 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.075398 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.075505 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.075776 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.075954 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.076181 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.076323 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.076525 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.076726 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.076888 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.077028 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.077170 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.077288 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.077519 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.077638 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.077839 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.077942 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.078166 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.078262 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.078480 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.078585 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.078804 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.078900 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.079128 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.079223 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.079445 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.079548 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.079756 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.079851 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.080090 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.080184 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.080398 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.080509 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.080713 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.080818 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.081028 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.081127 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.081340 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.081447 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.081678 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.081775 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.081991 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.082087 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.082322 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.082433 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.082652 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.082755 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.082960 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.083056 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.083288 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.083385 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.083607 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.083705 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.083947 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.084039 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.084231 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.084328 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.084546 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.084641 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.084879 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.084996 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.085196 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.085294 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.085526 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.085622 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.085779 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 04 18:57:28.085888 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.086153 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.086470 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.086791 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.087112 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.087443 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.087775 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.088103 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.088433 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.088787 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.089108 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.089484 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.089840 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.090161 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.090499 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.090782 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 18:57:28.091028 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 04 18:57:28.109273 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG oslo_db.sqlalchemy.engines [None req-d504444a-fb73-454a-b639-d9c8389828e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102748) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 04 18:57:28.113977 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG oslo_db.sqlalchemy.engines [None req-144afb53-508d-4221-9f3c-041598eaa52f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 04 18:57:28.172695 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.context [None req-d504444a-fb73-454a-b639-d9c8389828e5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),86210640-9976-41e4-9a2e-686dd20f0fdb(cell1) {{(pid=102748) load_cells /opt/stack/nova/nova/context.py:464}} May 04 18:57:28.176558 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.context [None req-144afb53-508d-4221-9f3c-041598eaa52f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),86210640-9976-41e4-9a2e-686dd20f0fdb(cell1) {{(pid=102747) load_cells /opt/stack/nova/nova/context.py:464}} May 04 18:57:28.177022 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG oslo_concurrency.lockutils [None req-d504444a-fb73-454a-b639-d9c8389828e5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 18:57:28.178655 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG oslo_concurrency.lockutils [None req-d504444a-fb73-454a-b639-d9c8389828e5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 18:57:28.179483 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG oslo_concurrency.lockutils [None req-d504444a-fb73-454a-b639-d9c8389828e5 None None] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 18:57:28.180820 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG oslo_concurrency.lockutils [None req-144afb53-508d-4221-9f3c-041598eaa52f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 18:57:28.181440 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG oslo_concurrency.lockutils [None req-d504444a-fb73-454a-b639-d9c8389828e5 None None] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 18:57:28.182459 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG oslo_concurrency.lockutils [None req-144afb53-508d-4221-9f3c-041598eaa52f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 18:57:28.183262 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG oslo_concurrency.lockutils [None req-144afb53-508d-4221-9f3c-041598eaa52f None None] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 18:57:28.186210 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG oslo_concurrency.lockutils [None req-144afb53-508d-4221-9f3c-041598eaa52f None None] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 18:57:28.193025 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG oslo_db.sqlalchemy.engines [None req-d504444a-fb73-454a-b639-d9c8389828e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102748) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 04 18:57:28.196356 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG oslo_db.sqlalchemy.engines [None req-d504444a-fb73-454a-b639-d9c8389828e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102748) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 04 18:57:28.200187 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG oslo_db.sqlalchemy.engines [None req-144afb53-508d-4221-9f3c-041598eaa52f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 04 18:57:28.203784 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG oslo_db.sqlalchemy.engines [None req-144afb53-508d-4221-9f3c-041598eaa52f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 04 18:57:28.354893 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG oslo_db.sqlalchemy.engines [None req-d504444a-fb73-454a-b639-d9c8389828e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102748) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 04 18:57:28.361388 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG oslo_db.sqlalchemy.engines [None req-144afb53-508d-4221-9f3c-041598eaa52f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 04 18:57:28.694677 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: WARNING keystonemiddleware.auth_token [None req-d504444a-fb73-454a-b639-d9c8389828e5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 04 18:57:28.695738 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: WARNING keystonemiddleware.auth_token [None req-144afb53-508d-4221-9f3c-041598eaa52f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 04 18:57:28.701384 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: WARNING keystonemiddleware.auth_token [None req-d504444a-fb73-454a-b639-d9c8389828e5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 04 18:57:28.702400 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: WARNING keystonemiddleware.auth_token [None req-144afb53-508d-4221-9f3c-041598eaa52f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 04 18:57:29.045992 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: WARNING keystonemiddleware.auth_token [None req-d504444a-fb73-454a-b639-d9c8389828e5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 04 18:57:29.047416 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: WARNING keystonemiddleware.auth_token [None req-144afb53-508d-4221-9f3c-041598eaa52f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 04 18:57:29.051294 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: WARNING keystonemiddleware.auth_token [None req-d504444a-fb73-454a-b639-d9c8389828e5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 04 18:57:29.052769 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: WARNING keystonemiddleware.auth_token [None req-144afb53-508d-4221-9f3c-041598eaa52f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 04 18:57:29.056482 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557ec03219c0 pid: 102748 (default app) May 04 18:57:29.057995 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557ec03219c0 pid: 102747 (default app) May 04 18:57:29.059210 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi [None req-d504444a-fb73-454a-b639-d9c8389828e5 None None] Calling method '>' {{(pid=102748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 18:57:29.060395 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: INFO nova.api.openstack.requestlog [None req-d504444a-fb73-454a-b639-d9c8389828e5 None None] 10.222.0.69 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002352 May 04 18:57:29.060798 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: [pid: 102748|app: 0|req: 1/1] 10.222.0.69 () {50 vars in 788 bytes} [Wed May 4 18:57:29 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 18:58:46.777120 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi [None req-144afb53-508d-4221-9f3c-041598eaa52f None None] Calling method '>' {{(pid=102747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 18:58:46.779101 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: INFO nova.api.openstack.requestlog [None req-144afb53-508d-4221-9f3c-041598eaa52f None None] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003046 May 04 18:58:46.779889 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: [pid: 102747|app: 0|req: 1/2] 10.222.0.69 () {54 vars in 930 bytes} [Wed May 4 18:58:46 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 18:58:47.200610 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi [None req-ef9e0561-3270-4f44-b4dd-b94b45ccec3a admin admin] Calling method '>' {{(pid=102748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 18:58:47.230225 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: INFO nova.api.openstack.requestlog [None req-ef9e0561-3270-4f44-b4dd-b94b45ccec3a admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.444271 May 04 18:58:47.231054 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: [pid: 102748|app: 0|req: 2/3] 10.222.0.69 () {60 vars in 1291 bytes} [Wed May 4 18:58:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 18:58:49.539673 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi [None req-144afb53-508d-4221-9f3c-041598eaa52f None None] Calling method '>' {{(pid=102747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 18:58:49.540677 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: INFO nova.api.openstack.requestlog [None req-144afb53-508d-4221-9f3c-041598eaa52f None None] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 May 04 18:58:49.543953 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: [pid: 102747|app: 0|req: 2/4] 10.222.0.69 () {54 vars in 930 bytes} [Wed May 4 18:58:49 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 18:58:49.600228 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi [None req-a9b70ddc-51c9-47ef-8b32-f6527577ae7c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "ram": 256, "id": "c1", "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 1}} {{(pid=102748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 18:58:49.618766 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 04 18:58:49.618766 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: warnings.warn(msg) May 04 18:58:49.647168 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: INFO nova.api.openstack.requestlog [None req-a9b70ddc-51c9-47ef-8b32-f6527577ae7c admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.100311 May 04 18:58:49.647863 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: [pid: 102748|app: 0|req: 3/5] 10.222.0.69 () {64 vars in 1282 bytes} [Wed May 4 18:58:49 2022] POST /compute/v2.1/flavors => generated 407 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 04 18:58:49.874366 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi [None req-a7fb7cbf-a285-4540-99fb-460cbc4de4c1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 18:58:49.878363 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 04 18:58:49.878363 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: warnings.warn(msg) May 04 18:58:49.929410 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: INFO nova.api.openstack.requestlog [None req-a7fb7cbf-a285-4540-99fb-460cbc4de4c1 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.273499 May 04 18:58:49.931003 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: [pid: 102747|app: 0|req: 3/6] 10.222.0.69 () {64 vars in 1335 bytes} [Wed May 4 18:58:49 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 18:58:52.264946 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi [None req-a9b70ddc-51c9-47ef-8b32-f6527577ae7c admin admin] Calling method '>' {{(pid=102748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 18:58:52.266018 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: INFO nova.api.openstack.requestlog [None req-a9b70ddc-51c9-47ef-8b32-f6527577ae7c admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001546 May 04 18:58:52.266413 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: [pid: 102748|app: 0|req: 4/7] 10.222.0.69 () {54 vars in 930 bytes} [Wed May 4 18:58:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 18:58:52.369100 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi [None req-1c3ba91f-ed5a-4716-9786-700c1c63e7a3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "vcpus": 1, "ram": 512, "disk": 5, "id": "d1", "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=102747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 18:58:52.386925 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 04 18:58:52.386925 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: warnings.warn(msg) May 04 18:58:52.408804 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: INFO nova.api.openstack.requestlog [None req-1c3ba91f-ed5a-4716-9786-700c1c63e7a3 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.136220 May 04 18:58:52.409379 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: [pid: 102747|app: 0|req: 4/8] 10.222.0.69 () {64 vars in 1282 bytes} [Wed May 4 18:58:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 04 18:58:52.421967 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi [None req-95c30605-c104-4ff3-993e-14ca30a51d20 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 18:58:52.423387 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 04 18:58:52.423387 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: warnings.warn(msg) May 04 18:58:52.482060 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: INFO nova.api.openstack.requestlog [None req-95c30605-c104-4ff3-993e-14ca30a51d20 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.063990 May 04 18:58:52.482677 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: [pid: 102748|app: 0|req: 5/9] 10.222.0.69 () {64 vars in 1335 bytes} [Wed May 4 18:58:52 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 18:58:54.829781 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi [None req-1c3ba91f-ed5a-4716-9786-700c1c63e7a3 admin admin] Calling method '>' {{(pid=102747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 18:58:54.830720 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: INFO nova.api.openstack.requestlog [None req-1c3ba91f-ed5a-4716-9786-700c1c63e7a3 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001563 May 04 18:58:54.831325 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: [pid: 102747|app: 0|req: 5/10] 10.222.0.69 () {54 vars in 930 bytes} [Wed May 4 18:58:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 18:58:54.891987 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi [None req-4cd75ff7-8822-4e7e-9430-bd6c3e833076 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "disk": 10, "os-flavor-access:is_public": true, "name": "ds1G", "vcpus": 1, "ram": 1024, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 18:58:54.915808 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: INFO nova.api.openstack.requestlog [None req-4cd75ff7-8822-4e7e-9430-bd6c3e833076 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.078487 May 04 18:58:54.916465 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: [pid: 102748|app: 0|req: 6/11] 10.222.0.69 () {64 vars in 1282 bytes} [Wed May 4 18:58:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 04 18:58:54.928784 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi [None req-6110c2f0-aade-43a2-9e9a-bb19ee61de11 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 18:58:54.955673 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: INFO nova.api.openstack.requestlog [None req-6110c2f0-aade-43a2-9e9a-bb19ee61de11 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030616 May 04 18:58:54.956612 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: [pid: 102747|app: 0|req: 6/12] 10.222.0.69 () {64 vars in 1335 bytes} [Wed May 4 18:58:54 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 18:58:57.267416 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi [None req-4cd75ff7-8822-4e7e-9430-bd6c3e833076 admin admin] Calling method '>' {{(pid=102748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 18:58:57.268573 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: INFO nova.api.openstack.requestlog [None req-4cd75ff7-8822-4e7e-9430-bd6c3e833076 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001536 May 04 18:58:57.269337 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: [pid: 102748|app: 0|req: 7/13] 10.222.0.69 () {54 vars in 930 bytes} [Wed May 4 18:58:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 18:58:57.327507 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi [None req-b1d80fcd-d4c9-421c-895c-df5526851ee3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "name": "ds2G", "os-flavor-access:is_public": true, "ram": 2048, "swap": 0, "vcpus": 2, "rxtx_factor": 1.0}} {{(pid=102747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 18:58:57.346817 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: INFO nova.api.openstack.requestlog [None req-b1d80fcd-d4c9-421c-895c-df5526851ee3 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.071344 May 04 18:58:57.347384 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: [pid: 102747|app: 0|req: 7/14] 10.222.0.69 () {64 vars in 1282 bytes} [Wed May 4 18:58:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 04 18:58:57.359613 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi [None req-455f5094-d47c-430e-ac2a-cf490ab10566 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 18:58:57.381991 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: INFO nova.api.openstack.requestlog [None req-455f5094-d47c-430e-ac2a-cf490ab10566 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026135 May 04 18:58:57.382562 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: [pid: 102748|app: 0|req: 8/15] 10.222.0.69 () {64 vars in 1335 bytes} [Wed May 4 18:58:57 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 18:58:59.666949 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi [None req-b1d80fcd-d4c9-421c-895c-df5526851ee3 admin admin] Calling method '>' {{(pid=102747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 18:58:59.667950 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: INFO nova.api.openstack.requestlog [None req-b1d80fcd-d4c9-421c-895c-df5526851ee3 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 May 04 18:58:59.668545 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: [pid: 102747|app: 0|req: 8/16] 10.222.0.69 () {54 vars in 930 bytes} [Wed May 4 18:58:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 18:58:59.726317 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi [None req-cd25a70d-be8e-44b8-9c49-cf9cd2426778 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "id": "d4", "os-flavor-access:is_public": true, "disk": 20, "vcpus": 4, "swap": 0}} {{(pid=102748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 18:58:59.746275 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: INFO nova.api.openstack.requestlog [None req-cd25a70d-be8e-44b8-9c49-cf9cd2426778 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072114 May 04 18:58:59.747152 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: [pid: 102748|app: 0|req: 9/17] 10.222.0.69 () {64 vars in 1282 bytes} [Wed May 4 18:58:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 04 18:58:59.758443 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi [None req-81c20a48-46a4-471b-89a0-245982124f5e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 18:58:59.781668 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: INFO nova.api.openstack.requestlog [None req-81c20a48-46a4-471b-89a0-245982124f5e admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026917 May 04 18:58:59.782228 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: [pid: 102747|app: 0|req: 9/18] 10.222.0.69 () {64 vars in 1335 bytes} [Wed May 4 18:58:59 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 18:59:02.077196 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi [None req-cd25a70d-be8e-44b8-9c49-cf9cd2426778 admin admin] Calling method '>' {{(pid=102748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 18:59:02.078851 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: INFO nova.api.openstack.requestlog [None req-cd25a70d-be8e-44b8-9c49-cf9cd2426778 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002067 May 04 18:59:02.079251 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: [pid: 102748|app: 0|req: 10/19] 10.222.0.69 () {54 vars in 930 bytes} [Wed May 4 18:59:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 18:59:02.142591 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi [None req-3e089dec-023d-4755-9685-8535268b2145 admin admin] Calling method '>' {{(pid=102747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 18:59:02.166978 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: INFO nova.api.openstack.requestlog [None req-3e089dec-023d-4755-9685-8535268b2145 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.081823 May 04 18:59:02.167515 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: [pid: 102747|app: 0|req: 10/20] 10.222.0.69 () {60 vars in 1291 bytes} [Wed May 4 18:59:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 18:59:04.773163 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi [None req-cd25a70d-be8e-44b8-9c49-cf9cd2426778 admin admin] Calling method '>' {{(pid=102748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 18:59:04.774219 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: INFO nova.api.openstack.requestlog [None req-cd25a70d-be8e-44b8-9c49-cf9cd2426778 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 May 04 18:59:04.774619 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: [pid: 102748|app: 0|req: 11/21] 10.222.0.69 () {54 vars in 930 bytes} [Wed May 4 18:59:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 18:59:04.831997 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi [None req-846090fb-cacc-4982-bfd6-31f1bf3a5d75 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "1", "name": "m1.tiny", "vcpus": 1, "rxtx_factor": 1.0, "disk": 1, "ram": 512}} {{(pid=102747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 18:59:04.850421 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: INFO nova.api.openstack.requestlog [None req-846090fb-cacc-4982-bfd6-31f1bf3a5d75 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.070090 May 04 18:59:04.850979 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: [pid: 102747|app: 0|req: 11/22] 10.222.0.69 () {64 vars in 1282 bytes} [Wed May 4 18:59:04 2022] POST /compute/v2.1/flavors => generated 402 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 04 18:59:04.862383 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi [None req-08f7d38e-3122-4117-91b5-c7545c09f4bd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 18:59:04.886129 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: INFO nova.api.openstack.requestlog [None req-08f7d38e-3122-4117-91b5-c7545c09f4bd admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027330 May 04 18:59:04.886702 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: [pid: 102748|app: 0|req: 12/23] 10.222.0.69 () {64 vars in 1332 bytes} [Wed May 4 18:59:04 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 18:59:07.154769 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi [None req-846090fb-cacc-4982-bfd6-31f1bf3a5d75 admin admin] Calling method '>' {{(pid=102747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 18:59:07.155917 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: INFO nova.api.openstack.requestlog [None req-846090fb-cacc-4982-bfd6-31f1bf3a5d75 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001575 May 04 18:59:07.156321 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: [pid: 102747|app: 0|req: 12/24] 10.222.0.69 () {54 vars in 930 bytes} [Wed May 4 18:59:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 04 18:59:07.213375 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi [None req-35ec5d1d-306f-40d9-a173-e770f60cfa2a admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "id": "2", "disk": 20, "swap": 0, "ram": 2048, "name": "m1.small"}} {{(pid=102748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 18:59:07.231089 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: INFO nova.api.openstack.requestlog [None req-35ec5d1d-306f-40d9-a173-e770f60cfa2a admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.068902 May 04 18:59:07.231574 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: [pid: 102748|app: 0|req: 13/25] 10.222.0.69 () {64 vars in 1282 bytes} [Wed May 4 18:59:07 2022] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 04 18:59:07.243274 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi [None req-fc648032-4226-4af2-9a72-b93726b7618f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 18:59:07.267163 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: INFO nova.api.openstack.requestlog [None req-fc648032-4226-4af2-9a72-b93726b7618f admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027699 May 04 18:59:07.268082 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: [pid: 102747|app: 0|req: 13/26] 10.222.0.69 () {64 vars in 1332 bytes} [Wed May 4 18:59:07 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 18:59:09.547247 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi [None req-35ec5d1d-306f-40d9-a173-e770f60cfa2a admin admin] Calling method '>' {{(pid=102748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 18:59:09.548246 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: INFO nova.api.openstack.requestlog [None req-35ec5d1d-306f-40d9-a173-e770f60cfa2a admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 May 04 18:59:09.548638 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: [pid: 102748|app: 0|req: 14/27] 10.222.0.69 () {54 vars in 930 bytes} [Wed May 4 18:59:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 18:59:09.607791 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi [None req-3f8c9ead-e789-406f-b5c8-161e96a1eef2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "ram": 4096, "os-flavor-access:is_public": true, "disk": 40, "swap": 0, "id": "3", "name": "m1.medium", "rxtx_factor": 1.0}} {{(pid=102747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 18:59:09.625270 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: INFO nova.api.openstack.requestlog [None req-3f8c9ead-e789-406f-b5c8-161e96a1eef2 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.070785 May 04 18:59:09.626065 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: [pid: 102747|app: 0|req: 14/28] 10.222.0.69 () {64 vars in 1282 bytes} [Wed May 4 18:59:09 2022] POST /compute/v2.1/flavors => generated 406 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 04 18:59:09.638006 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi [None req-55beaf8e-15a7-4b28-a692-fad83b00f9f5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 18:59:09.659671 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: INFO nova.api.openstack.requestlog [None req-55beaf8e-15a7-4b28-a692-fad83b00f9f5 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025299 May 04 18:59:09.660247 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: [pid: 102748|app: 0|req: 15/29] 10.222.0.69 () {64 vars in 1332 bytes} [Wed May 4 18:59:09 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 18:59:11.954105 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi [None req-3f8c9ead-e789-406f-b5c8-161e96a1eef2 admin admin] Calling method '>' {{(pid=102747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 18:59:11.955127 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: INFO nova.api.openstack.requestlog [None req-3f8c9ead-e789-406f-b5c8-161e96a1eef2 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 May 04 18:59:11.955535 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: [pid: 102747|app: 0|req: 15/30] 10.222.0.69 () {54 vars in 930 bytes} [Wed May 4 18:59:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 18:59:12.011071 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi [None req-555e177f-a522-444a-917c-d6ad53997b4f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "name": "m1.large", "id": "4", "disk": 80, "os-flavor-access:is_public": true, "ram": 8192, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 18:59:12.029394 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: INFO nova.api.openstack.requestlog [None req-555e177f-a522-444a-917c-d6ad53997b4f admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.067526 May 04 18:59:12.030952 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: [pid: 102748|app: 0|req: 16/31] 10.222.0.69 () {64 vars in 1282 bytes} [Wed May 4 18:59:11 2022] POST /compute/v2.1/flavors => generated 405 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 04 18:59:12.042234 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi [None req-1ea838df-6caf-43da-a7c9-b93793a4bab2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 18:59:12.065489 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: INFO nova.api.openstack.requestlog [None req-1ea838df-6caf-43da-a7c9-b93793a4bab2 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027529 May 04 18:59:12.066078 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: [pid: 102747|app: 0|req: 16/32] 10.222.0.69 () {64 vars in 1332 bytes} [Wed May 4 18:59:12 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 18:59:14.387747 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi [None req-555e177f-a522-444a-917c-d6ad53997b4f admin admin] Calling method '>' {{(pid=102748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 18:59:14.388771 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: INFO nova.api.openstack.requestlog [None req-555e177f-a522-444a-917c-d6ad53997b4f admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 May 04 18:59:14.389363 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: [pid: 102748|app: 0|req: 17/33] 10.222.0.69 () {54 vars in 930 bytes} [Wed May 4 18:59:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 18:59:14.451713 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi [None req-36cca7fd-7f44-47c8-a8b3-914c97ec1d70 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.xlarge", "vcpus": 8, "id": "5", "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 160, "rxtx_factor": 1.0}} {{(pid=102747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 18:59:14.472498 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: INFO nova.api.openstack.requestlog [None req-36cca7fd-7f44-47c8-a8b3-914c97ec1d70 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.076965 May 04 18:59:14.473039 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: [pid: 102747|app: 0|req: 17/34] 10.222.0.69 () {64 vars in 1282 bytes} [Wed May 4 18:59:14 2022] POST /compute/v2.1/flavors => generated 408 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 04 18:59:14.485666 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi [None req-df893269-ebe2-47f0-b79f-fca3e209b08b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 18:59:14.509293 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: INFO nova.api.openstack.requestlog [None req-df893269-ebe2-47f0-b79f-fca3e209b08b admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027397 May 04 18:59:14.510256 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: [pid: 102748|app: 0|req: 18/35] 10.222.0.69 () {64 vars in 1332 bytes} [Wed May 4 18:59:14 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 18:59:38.639389 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi [None req-36cca7fd-7f44-47c8-a8b3-914c97ec1d70 admin admin] Calling method '>' {{(pid=102747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 18:59:38.640395 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: INFO nova.api.openstack.requestlog [None req-36cca7fd-7f44-47c8-a8b3-914c97ec1d70 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 May 04 18:59:38.640783 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: [pid: 102747|app: 0|req: 18/36] 10.222.0.69 () {54 vars in 930 bytes} [Wed May 4 18:59:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 18:59:38.696611 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi [None req-8527ce76-a3a6-46b6-84ad-4c09e45cf990 admin admin] Calling method '>' {{(pid=102748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 18:59:38.713159 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: INFO nova.api.openstack.requestlog [None req-8527ce76-a3a6-46b6-84ad-4c09e45cf990 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.066483 May 04 18:59:38.713706 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: [pid: 102748|app: 0|req: 19/37] 10.222.0.69 () {60 vars in 1291 bytes} [Wed May 4 18:59:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 04 18:59:40.036272 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi [None req-36cca7fd-7f44-47c8-a8b3-914c97ec1d70 admin admin] Calling method '>' {{(pid=102747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 18:59:40.037307 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: INFO nova.api.openstack.requestlog [None req-36cca7fd-7f44-47c8-a8b3-914c97ec1d70 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 May 04 18:59:40.037754 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: [pid: 102747|app: 0|req: 19/38] 10.222.0.69 () {56 vars in 1074 bytes} [Wed May 4 18:59:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 18:59:40.239119 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi [None req-e3b4bf2e-5119-4696-9529-7bf9ab671a92 admin admin] Calling method '>' {{(pid=102748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 18:59:40.245279 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: INFO nova.api.openstack.wsgi [None req-e3b4bf2e-5119-4696-9529-7bf9ab671a92 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 04 18:59:40.245876 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi [None req-e3b4bf2e-5119-4696-9529-7bf9ab671a92 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 04 18:59:40.246672 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: INFO nova.api.openstack.requestlog [None req-e3b4bf2e-5119-4696-9529-7bf9ab671a92 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.056871 May 04 18:59:40.247182 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: [pid: 102748|app: 0|req: 20/39] 10.222.0.69 () {60 vars in 1190 bytes} [Wed May 4 18:59:40 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 04 18:59:40.256304 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi [None req-a3536a5f-9013-4bac-b9c0-8090aa323e39 admin admin] Calling method '>' {{(pid=102747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 18:59:40.276709 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: INFO nova.api.openstack.requestlog [None req-a3536a5f-9013-4bac-b9c0-8090aa323e39 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024032 May 04 18:59:40.277233 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: [pid: 102747|app: 0|req: 20/40] 10.222.0.69 () {60 vars in 1210 bytes} [Wed May 4 18:59:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 04 18:59:40.286569 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi [None req-706051cd-b222-40c3-8248-90dedaee5d58 admin admin] Calling method '>' {{(pid=102748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 18:59:40.308054 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: INFO nova.api.openstack.requestlog [None req-706051cd-b222-40c3-8248-90dedaee5d58 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024984 May 04 18:59:40.308577 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: [pid: 102748|app: 0|req: 21/41] 10.222.0.69 () {60 vars in 1210 bytes} [Wed May 4 18:59:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 04 18:59:40.317572 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi [None req-e71192ad-ae76-44d6-af5d-388de5cf6157 admin admin] Calling method '>' {{(pid=102747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 18:59:40.322927 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: INFO nova.api.openstack.wsgi [None req-e71192ad-ae76-44d6-af5d-388de5cf6157 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 04 18:59:40.323493 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi [None req-e71192ad-ae76-44d6-af5d-388de5cf6157 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 04 18:59:40.324278 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: INFO nova.api.openstack.requestlog [None req-e71192ad-ae76-44d6-af5d-388de5cf6157 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010209 May 04 18:59:40.324775 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: [pid: 102747|app: 0|req: 21/42] 10.222.0.69 () {60 vars in 1190 bytes} [Wed May 4 18:59:40 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 04 18:59:41.516005 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi [None req-706051cd-b222-40c3-8248-90dedaee5d58 admin admin] Calling method '>' {{(pid=102748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 18:59:41.517019 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: INFO nova.api.openstack.requestlog [None req-706051cd-b222-40c3-8248-90dedaee5d58 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 May 04 18:59:41.517412 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: [pid: 102748|app: 0|req: 22/43] 10.222.0.69 () {56 vars in 1074 bytes} [Wed May 4 18:59:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 18:59:41.705893 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi [None req-2185808a-698e-40e2-a181-58087b1ba2a4 admin admin] Calling method '>' {{(pid=102747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 18:59:41.711440 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: INFO nova.api.openstack.wsgi [None req-2185808a-698e-40e2-a181-58087b1ba2a4 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 04 18:59:41.711998 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi [None req-2185808a-698e-40e2-a181-58087b1ba2a4 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 04 18:59:41.712779 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: INFO nova.api.openstack.requestlog [None req-2185808a-698e-40e2-a181-58087b1ba2a4 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.057220 May 04 18:59:41.713309 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: [pid: 102747|app: 0|req: 22/44] 10.222.0.69 () {60 vars in 1190 bytes} [Wed May 4 18:59:41 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 04 18:59:41.722794 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi [None req-9cc44cc8-bf1b-48dd-8eea-a73f3e6c3507 admin admin] Calling method '>' {{(pid=102748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 18:59:41.736791 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: INFO nova.api.openstack.requestlog [None req-9cc44cc8-bf1b-48dd-8eea-a73f3e6c3507 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017850 May 04 18:59:41.737260 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: [pid: 102748|app: 0|req: 23/45] 10.222.0.69 () {60 vars in 1210 bytes} [Wed May 4 18:59:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 18:59:41.746834 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi [None req-7bd6e72f-45c0-41d1-8df7-9ef6f13c496d admin admin] Calling method '>' {{(pid=102747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 18:59:41.759880 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: INFO nova.api.openstack.requestlog [None req-7bd6e72f-45c0-41d1-8df7-9ef6f13c496d admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016397 May 04 18:59:41.760388 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: [pid: 102747|app: 0|req: 23/46] 10.222.0.69 () {60 vars in 1210 bytes} [Wed May 4 18:59:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 04 18:59:41.769302 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi [None req-c7cc8dfb-1fcd-46dd-b100-cb1f993addc7 admin admin] Calling method '>' {{(pid=102748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 18:59:41.774306 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: INFO nova.api.openstack.wsgi [None req-c7cc8dfb-1fcd-46dd-b100-cb1f993addc7 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 04 18:59:41.774869 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi [None req-c7cc8dfb-1fcd-46dd-b100-cb1f993addc7 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 04 18:59:41.775621 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: INFO nova.api.openstack.requestlog [None req-c7cc8dfb-1fcd-46dd-b100-cb1f993addc7 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.009962 May 04 18:59:41.776096 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: [pid: 102748|app: 0|req: 24/47] 10.222.0.69 () {60 vars in 1190 bytes} [Wed May 4 18:59:41 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 04 18:59:42.983753 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi [None req-7bd6e72f-45c0-41d1-8df7-9ef6f13c496d admin admin] Calling method '>' {{(pid=102747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 18:59:42.984790 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: INFO nova.api.openstack.requestlog [None req-7bd6e72f-45c0-41d1-8df7-9ef6f13c496d admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 May 04 18:59:42.985184 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: [pid: 102747|app: 0|req: 24/48] 10.222.0.69 () {56 vars in 1074 bytes} [Wed May 4 18:59:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 18:59:43.171532 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi [None req-fc185130-0ed9-4669-92cc-f0d4eaab4e30 admin admin] Calling method '>' {{(pid=102748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 18:59:43.177020 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: INFO nova.api.openstack.wsgi [None req-fc185130-0ed9-4669-92cc-f0d4eaab4e30 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 04 18:59:43.177614 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi [None req-fc185130-0ed9-4669-92cc-f0d4eaab4e30 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 04 18:59:43.178388 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: INFO nova.api.openstack.requestlog [None req-fc185130-0ed9-4669-92cc-f0d4eaab4e30 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.056254 May 04 18:59:43.179521 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: [pid: 102748|app: 0|req: 25/49] 10.222.0.69 () {60 vars in 1193 bytes} [Wed May 4 18:59:43 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 04 18:59:43.188621 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi [None req-0f2229e9-a911-4230-b52d-2d4d517af581 admin admin] Calling method '>' {{(pid=102747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 18:59:43.202259 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: INFO nova.api.openstack.requestlog [None req-0f2229e9-a911-4230-b52d-2d4d517af581 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017131 May 04 18:59:43.202737 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: [pid: 102747|app: 0|req: 25/50] 10.222.0.69 () {60 vars in 1210 bytes} [Wed May 4 18:59:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 04 18:59:43.211994 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi [None req-48febc70-2417-4756-a3be-b03469478f0a admin admin] Calling method '>' {{(pid=102748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 18:59:43.225534 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: INFO nova.api.openstack.requestlog [None req-48febc70-2417-4756-a3be-b03469478f0a admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017038 May 04 18:59:43.226557 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: [pid: 102748|app: 0|req: 26/51] 10.222.0.69 () {60 vars in 1210 bytes} [Wed May 4 18:59:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 18:59:43.235462 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi [None req-988deb19-6516-4e5b-ab73-e32e3f4128a5 admin admin] Calling method '>' {{(pid=102747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 18:59:43.240591 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: INFO nova.api.openstack.wsgi [None req-988deb19-6516-4e5b-ab73-e32e3f4128a5 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 04 18:59:43.241151 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi [None req-988deb19-6516-4e5b-ab73-e32e3f4128a5 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 04 18:59:43.242816 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: INFO nova.api.openstack.requestlog [None req-988deb19-6516-4e5b-ab73-e32e3f4128a5 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010777 May 04 18:59:43.243358 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: [pid: 102747|app: 0|req: 26/52] 10.222.0.69 () {60 vars in 1193 bytes} [Wed May 4 18:59:43 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 04 18:59:44.431972 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi [None req-48febc70-2417-4756-a3be-b03469478f0a admin admin] Calling method '>' {{(pid=102748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 18:59:44.432988 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: INFO nova.api.openstack.requestlog [None req-48febc70-2417-4756-a3be-b03469478f0a admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 May 04 18:59:44.433389 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: [pid: 102748|app: 0|req: 27/53] 10.222.0.69 () {56 vars in 1074 bytes} [Wed May 4 18:59:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 18:59:44.645910 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi [None req-6b3c6450-f95d-4db6-b2dc-c30f9e3f62e4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 18:59:44.663425 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: INFO nova.api.openstack.requestlog [None req-6b3c6450-f95d-4db6-b2dc-c30f9e3f62e4 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.094526 May 04 18:59:44.663960 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: [pid: 102747|app: 0|req: 27/54] 10.222.0.69 () {64 vars in 1235 bytes} [Wed May 4 18:59:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 04 18:59:45.869248 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi [None req-48febc70-2417-4756-a3be-b03469478f0a admin admin] Calling method '>' {{(pid=102748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 18:59:45.870285 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: INFO nova.api.openstack.requestlog [None req-48febc70-2417-4756-a3be-b03469478f0a admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 May 04 18:59:45.870681 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: [pid: 102748|app: 0|req: 28/55] 10.222.0.69 () {56 vars in 1074 bytes} [Wed May 4 18:59:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 18:59:46.056576 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi [None req-f9f1d131-3a21-40b7-95d4-43575143f03b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 18:59:46.073345 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: INFO nova.api.openstack.requestlog [None req-f9f1d131-3a21-40b7-95d4-43575143f03b admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.066875 May 04 18:59:46.073910 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: [pid: 102747|app: 0|req: 28/56] 10.222.0.69 () {64 vars in 1235 bytes} [Wed May 4 18:59:46 2022] POST /compute/v2.1/flavors => generated 405 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 04 18:59:47.277860 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi [None req-48febc70-2417-4756-a3be-b03469478f0a admin admin] Calling method '>' {{(pid=102748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 18:59:47.278858 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: INFO nova.api.openstack.requestlog [None req-48febc70-2417-4756-a3be-b03469478f0a admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 May 04 18:59:47.279258 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: [pid: 102748|app: 0|req: 29/57] 10.222.0.69 () {56 vars in 1074 bytes} [Wed May 4 18:59:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 18:59:47.466879 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi [None req-c9fe542f-aa45-4e27-af3e-ea3300b77a4b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 18:59:47.483983 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: INFO nova.api.openstack.requestlog [None req-c9fe542f-aa45-4e27-af3e-ea3300b77a4b admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.066848 May 04 18:59:47.484526 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: [pid: 102747|app: 0|req: 29/58] 10.222.0.69 () {64 vars in 1235 bytes} [Wed May 4 18:59:47 2022] POST /compute/v2.1/flavors => generated 407 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 04 18:59:48.690057 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi [None req-48febc70-2417-4756-a3be-b03469478f0a admin admin] Calling method '>' {{(pid=102748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 18:59:48.691051 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: INFO nova.api.openstack.requestlog [None req-48febc70-2417-4756-a3be-b03469478f0a admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 May 04 18:59:48.691447 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: [pid: 102748|app: 0|req: 30/59] 10.222.0.69 () {56 vars in 1074 bytes} [Wed May 4 18:59:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 18:59:48.875182 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi [None req-6a81d36a-c856-47c2-a41b-ea61c4a98960 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 18:59:48.893584 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: INFO nova.api.openstack.requestlog [None req-6a81d36a-c856-47c2-a41b-ea61c4a98960 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.067866 May 04 18:59:48.894366 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: [pid: 102747|app: 0|req: 30/60] 10.222.0.69 () {64 vars in 1235 bytes} [Wed May 4 18:59:48 2022] POST /compute/v2.1/flavors => generated 409 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 04 18:59:50.092310 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi [None req-48febc70-2417-4756-a3be-b03469478f0a admin admin] Calling method '>' {{(pid=102748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 18:59:50.093327 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: INFO nova.api.openstack.requestlog [None req-48febc70-2417-4756-a3be-b03469478f0a admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 May 04 18:59:50.093751 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: [pid: 102748|app: 0|req: 31/61] 10.222.0.69 () {56 vars in 1074 bytes} [Wed May 4 18:59:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 18:59:50.284053 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi [None req-1bf7cae8-9ee0-47df-897f-047b754d4e62 admin admin] Calling method '>' {{(pid=102747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 18:59:50.303497 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: INFO nova.api.openstack.requestlog [None req-1bf7cae8-9ee0-47df-897f-047b754d4e62 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.072213 May 04 18:59:50.304033 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: [pid: 102747|app: 0|req: 31/62] 10.222.0.69 () {60 vars in 1202 bytes} [Wed May 4 18:59:50 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:00:52.501256 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi [None req-48febc70-2417-4756-a3be-b03469478f0a admin admin] Calling method '>' {{(pid=102748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:00:52.502287 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: INFO nova.api.openstack.requestlog [None req-48febc70-2417-4756-a3be-b03469478f0a admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 May 04 19:00:52.502684 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: [pid: 102748|app: 0|req: 32/63] 10.222.0.69 () {54 vars in 930 bytes} [Wed May 4 19:00:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:00:52.560175 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi [None req-6faf9e9c-8f98-4135-908d-eeca338d1687 admin admin] Calling method '>' {{(pid=102747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:00:52.578916 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: INFO nova.api.openstack.requestlog [None req-6faf9e9c-8f98-4135-908d-eeca338d1687 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070667 May 04 19:00:52.579453 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: [pid: 102747|app: 0|req: 32/64] 10.222.0.69 () {60 vars in 1291 bytes} [Wed May 4 19:00:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:00:52.602338 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi [None req-152e71a5-5d1f-41d5-b1cf-7b10bcd6cce7 admin admin] Calling method '>' {{(pid=102748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:00:52.609917 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: INFO nova.api.openstack.requestlog [None req-152e71a5-5d1f-41d5-b1cf-7b10bcd6cce7 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012515 May 04 19:00:52.610439 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: [pid: 102748|app: 0|req: 33/65] 10.222.0.69 () {60 vars in 1282 bytes} [Wed May 4 19:00:52 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:00:52.621735 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi [None req-e3cf6ff5-fb76-4629-aebb-ff2186f03d6c admin admin] Calling method '>' {{(pid=102747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:00:52.629123 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: INFO nova.api.openstack.requestlog [None req-e3cf6ff5-fb76-4629-aebb-ff2186f03d6c admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010888 May 04 19:00:52.629746 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: [pid: 102747|app: 0|req: 33/66] 10.222.0.69 () {60 vars in 1285 bytes} [Wed May 4 19:00:52 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:00:52.640681 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi [None req-1dc510c9-b96a-4b2c-8e3e-80da70e609bd admin admin] Calling method '>' {{(pid=102748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:00:52.648852 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: INFO nova.api.openstack.requestlog [None req-1dc510c9-b96a-4b2c-8e3e-80da70e609bd admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011725 May 04 19:00:52.649363 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: [pid: 102748|app: 0|req: 34/67] 10.222.0.69 () {60 vars in 1285 bytes} [Wed May 4 19:00:52 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:00:52.659876 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi [None req-32b13f9a-4dc7-4f6a-8f15-6b62fed64798 admin admin] Calling method '>' {{(pid=102747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:00:52.667869 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: INFO nova.api.openstack.requestlog [None req-32b13f9a-4dc7-4f6a-8f15-6b62fed64798 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011416 May 04 19:00:52.668383 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: [pid: 102747|app: 0|req: 34/68] 10.222.0.69 () {60 vars in 1282 bytes} [Wed May 4 19:00:52 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:02:31.533971 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi [None req-b0409bba-1b44-4bbd-ab14-6151f5847d2a tempest-verify_tempest_config-77055586 tempest-verify_tempest_config-77055586-project] Calling method '>' {{(pid=102748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:02:31.535964 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: INFO nova.api.openstack.requestlog [None req-b0409bba-1b44-4bbd-ab14-6151f5847d2a tempest-verify_tempest_config-77055586 tempest-verify_tempest_config-77055586-project] 10.222.0.69 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.103540 May 04 19:02:31.536495 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: [pid: 102748|app: 0|req: 35/69] 10.222.0.69 () {58 vars in 1133 bytes} [Wed May 4 19:02:31 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 04 19:04:10.455705 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi [None req-32b13f9a-4dc7-4f6a-8f15-6b62fed64798 admin admin] Calling method '>' {{(pid=102747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:04:10.456721 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: INFO nova.api.openstack.requestlog [None req-32b13f9a-4dc7-4f6a-8f15-6b62fed64798 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 May 04 19:04:10.457115 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: [pid: 102747|app: 0|req: 35/70] 10.222.0.69 () {56 vars in 1074 bytes} [Wed May 4 19:04:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:04:10.705184 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi [None req-5b9a2c32-8a07-46e7-bdd9-1f0f088a1a9e admin admin] Calling method '>' {{(pid=102748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:04:10.706397 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 04 19:04:10.706397 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: warnings.warn(msg) May 04 19:04:10.707620 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG oslo_concurrency.lockutils [None req-5b9a2c32-8a07-46e7-bdd9-1f0f088a1a9e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:04:10.708052 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG oslo_concurrency.lockutils [None req-5b9a2c32-8a07-46e7-bdd9-1f0f088a1a9e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:04:10.708943 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG oslo_concurrency.lockutils [None req-5b9a2c32-8a07-46e7-bdd9-1f0f088a1a9e admin admin] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:04:10.709372 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG oslo_concurrency.lockutils [None req-5b9a2c32-8a07-46e7-bdd9-1f0f088a1a9e admin admin] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:04:10.742534 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: INFO nova.api.openstack.requestlog [None req-5b9a2c32-8a07-46e7-bdd9-1f0f088a1a9e admin admin] 10.222.0.69 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.146868 May 04 19:04:10.743090 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: [pid: 102748|app: 0|req: 36/71] 10.222.0.69 () {60 vars in 1193 bytes} [Wed May 4 19:04:10 2022] GET /compute/v2.1/os-services => generated 791 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 04 19:04:11.958616 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi [None req-32b13f9a-4dc7-4f6a-8f15-6b62fed64798 admin admin] Calling method '>' {{(pid=102747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:04:11.959649 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: INFO nova.api.openstack.requestlog [None req-32b13f9a-4dc7-4f6a-8f15-6b62fed64798 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 May 04 19:04:11.960049 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: [pid: 102747|app: 0|req: 36/72] 10.222.0.69 () {56 vars in 1074 bytes} [Wed May 4 19:04:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:04:12.147942 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi [None req-696c6741-846b-40ab-8cf1-19b95e3cb1fd admin admin] Calling method '>' {{(pid=102748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:04:12.149137 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 04 19:04:12.149137 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: warnings.warn(msg) May 04 19:04:12.150344 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG oslo_concurrency.lockutils [None req-696c6741-846b-40ab-8cf1-19b95e3cb1fd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:04:12.150785 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG oslo_concurrency.lockutils [None req-696c6741-846b-40ab-8cf1-19b95e3cb1fd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:04:12.151590 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG oslo_concurrency.lockutils [None req-696c6741-846b-40ab-8cf1-19b95e3cb1fd admin admin] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:04:12.152015 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG oslo_concurrency.lockutils [None req-696c6741-846b-40ab-8cf1-19b95e3cb1fd admin admin] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:04:12.170868 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: INFO nova.api.openstack.requestlog [None req-696c6741-846b-40ab-8cf1-19b95e3cb1fd admin admin] 10.222.0.69 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.073600 May 04 19:04:12.171873 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: [pid: 102748|app: 0|req: 37/73] 10.222.0.69 () {60 vars in 1193 bytes} [Wed May 4 19:04:12 2022] GET /compute/v2.1/os-services => generated 791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 04 19:04:23.792391 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi [None req-32b13f9a-4dc7-4f6a-8f15-6b62fed64798 admin admin] Calling method '>' {{(pid=102747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:04:23.793402 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: INFO nova.api.openstack.requestlog [None req-32b13f9a-4dc7-4f6a-8f15-6b62fed64798 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 May 04 19:04:23.793818 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: [pid: 102747|app: 0|req: 37/74] 10.222.0.69 () {56 vars in 1074 bytes} [Wed May 4 19:04:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:04:23.984807 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi [None req-eb9a86e4-a3c9-4485-85ed-4215296ed447 admin admin] Calling method '>' {{(pid=102748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:04:23.986072 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 04 19:04:23.986072 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: warnings.warn(msg) May 04 19:04:23.988874 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG oslo_concurrency.lockutils [None req-eb9a86e4-a3c9-4485-85ed-4215296ed447 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:04:23.988874 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG oslo_concurrency.lockutils [None req-eb9a86e4-a3c9-4485-85ed-4215296ed447 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:04:23.989300 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG oslo_concurrency.lockutils [None req-eb9a86e4-a3c9-4485-85ed-4215296ed447 admin admin] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:04:23.994380 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG oslo_concurrency.lockutils [None req-eb9a86e4-a3c9-4485-85ed-4215296ed447 admin admin] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:04:24.015064 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: INFO nova.api.openstack.requestlog [None req-eb9a86e4-a3c9-4485-85ed-4215296ed447 admin admin] 10.222.0.69 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.084818 May 04 19:04:24.015558 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: [pid: 102748|app: 0|req: 38/75] 10.222.0.69 () {60 vars in 1193 bytes} [Wed May 4 19:04:23 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:04:25.237853 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: DEBUG nova.api.openstack.wsgi [None req-32b13f9a-4dc7-4f6a-8f15-6b62fed64798 admin admin] Calling method '>' {{(pid=102747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:04:25.238894 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: INFO nova.api.openstack.requestlog [None req-32b13f9a-4dc7-4f6a-8f15-6b62fed64798 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 May 04 19:04:25.239285 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: [pid: 102747|app: 0|req: 38/76] 10.222.0.69 () {56 vars in 1074 bytes} [Wed May 4 19:04:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:04:25.433666 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG nova.api.openstack.wsgi [None req-37938b11-92f0-430d-8bdf-d4c76aca1a50 admin admin] Calling method '>' {{(pid=102748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:04:25.434831 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 04 19:04:25.434831 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: warnings.warn(msg) May 04 19:04:25.436013 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG oslo_concurrency.lockutils [None req-37938b11-92f0-430d-8bdf-d4c76aca1a50 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:04:25.437003 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG oslo_concurrency.lockutils [None req-37938b11-92f0-430d-8bdf-d4c76aca1a50 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:04:25.437830 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG oslo_concurrency.lockutils [None req-37938b11-92f0-430d-8bdf-d4c76aca1a50 admin admin] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:04:25.438259 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: DEBUG oslo_concurrency.lockutils [None req-37938b11-92f0-430d-8bdf-d4c76aca1a50 admin admin] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:04:25.459822 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: INFO nova.api.openstack.requestlog [None req-37938b11-92f0-430d-8bdf-d4c76aca1a50 admin admin] 10.222.0.69 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.077230 May 04 19:04:25.460295 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: [pid: 102748|app: 0|req: 39/77] 10.222.0.69 () {60 vars in 1193 bytes} [Wed May 4 19:04:25 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:05:20.699185 dv-cinder-830901-3-iscsi devstack@n-api.service[102746]: Wed May 4 19:05:20 2022 - graceful shutdown triggered... May 04 19:05:20.699303 dv-cinder-830901-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 04 19:05:20.700210 dv-cinder-830901-3-iscsi devstack@n-api.service[102747]: Gracefully killing worker 1 (pid: 102747)... May 04 19:05:20.700611 dv-cinder-830901-3-iscsi devstack@n-api.service[102748]: Gracefully killing worker 2 (pid: 102748)... May 04 19:05:21.701257 dv-cinder-830901-3-iscsi devstack@n-api.service[102746]: worker 1 buried after 1 seconds May 04 19:05:21.701257 dv-cinder-830901-3-iscsi devstack@n-api.service[102746]: worker 2 buried after 1 seconds May 04 19:05:21.701257 dv-cinder-830901-3-iscsi devstack@n-api.service[102746]: goodbye to uWSGI. May 04 19:05:21.702821 dv-cinder-830901-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 04 19:05:21.703394 dv-cinder-830901-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 04 19:05:21.706156 dv-cinder-830901-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 04 19:05:21.720741 dv-cinder-830901-3-iscsi devstack@n-api.service[117103]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 04 19:05:21.749386 dv-cinder-830901-3-iscsi devstack@n-api.service[117103]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 4 19:05:21 2022] *** May 04 19:05:21.749386 dv-cinder-830901-3-iscsi devstack@n-api.service[117103]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 04 19:05:21.749386 dv-cinder-830901-3-iscsi devstack@n-api.service[117103]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 04 19:05:21.749386 dv-cinder-830901-3-iscsi devstack@n-api.service[117103]: nodename: dv-cinder-830901-3-iscsi May 04 19:05:21.749386 dv-cinder-830901-3-iscsi devstack@n-api.service[117103]: machine: x86_64 May 04 19:05:21.749386 dv-cinder-830901-3-iscsi devstack@n-api.service[117103]: clock source: unix May 04 19:05:21.749386 dv-cinder-830901-3-iscsi devstack@n-api.service[117103]: pcre jit disabled May 04 19:05:21.749386 dv-cinder-830901-3-iscsi devstack@n-api.service[117103]: detected number of CPU cores: 4 May 04 19:05:21.749386 dv-cinder-830901-3-iscsi devstack@n-api.service[117103]: current working directory: / May 04 19:05:21.749386 dv-cinder-830901-3-iscsi devstack@n-api.service[117103]: detected binary path: /usr/bin/uwsgi-core May 04 19:05:21.749386 dv-cinder-830901-3-iscsi devstack@n-api.service[117103]: your processes number limit is 47680 May 04 19:05:21.749386 dv-cinder-830901-3-iscsi devstack@n-api.service[117103]: your memory page size is 4096 bytes May 04 19:05:21.749386 dv-cinder-830901-3-iscsi devstack@n-api.service[117103]: detected max file descriptor number: 2048 May 04 19:05:21.750601 dv-cinder-830901-3-iscsi devstack@n-api.service[117103]: lock engine: pthread robust mutexes May 04 19:05:21.750601 dv-cinder-830901-3-iscsi devstack@n-api.service[117103]: thunder lock: enabled May 04 19:05:21.750601 dv-cinder-830901-3-iscsi devstack@n-api.service[117103]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 04 19:05:21.750601 dv-cinder-830901-3-iscsi devstack@n-api.service[117103]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 04 19:05:21.799523 dv-cinder-830901-3-iscsi devstack@n-api.service[117103]: Python main interpreter initialized at 0x55a6b2d669c0 May 04 19:05:21.799523 dv-cinder-830901-3-iscsi devstack@n-api.service[117103]: python threads support enabled May 04 19:05:21.799523 dv-cinder-830901-3-iscsi devstack@n-api.service[117103]: your server socket listen backlog is limited to 100 connections May 04 19:05:21.799523 dv-cinder-830901-3-iscsi devstack@n-api.service[117103]: your mercy for graceful operations on workers is 90 seconds May 04 19:05:21.799983 dv-cinder-830901-3-iscsi devstack@n-api.service[117103]: mapped 403077 bytes (393 KB) for 2 cores May 04 19:05:21.799983 dv-cinder-830901-3-iscsi devstack@n-api.service[117103]: *** Operational MODE: preforking *** May 04 19:05:21.800239 dv-cinder-830901-3-iscsi devstack@n-api.service[117103]: *** uWSGI is running in multiple interpreter mode *** May 04 19:05:21.800239 dv-cinder-830901-3-iscsi devstack@n-api.service[117103]: spawned uWSGI master process (pid: 117103) May 04 19:05:21.800441 dv-cinder-830901-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 04 19:05:21.801157 dv-cinder-830901-3-iscsi devstack@n-api.service[117103]: spawned uWSGI worker 1 (pid: 117124, cores: 1) May 04 19:05:21.802360 dv-cinder-830901-3-iscsi devstack@n-api.service[117103]: spawned uWSGI worker 2 (pid: 117125, cores: 1) May 04 19:05:21.802360 dv-cinder-830901-3-iscsi devstack@n-api.service[117103]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 04 19:05:23.013731 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 04 19:05:23.014840 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 04 19:05:23.807951 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 04 19:05:23.807951 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: from cryptography.utils import int_from_bytes May 04 19:05:23.808266 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 04 19:05:23.808266 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: from cryptography.utils import int_from_bytes May 04 19:05:23.808428 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 04 19:05:23.808428 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: from cryptography.utils import int_from_bytes May 04 19:05:23.808562 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 04 19:05:23.808562 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: from cryptography.utils import int_from_bytes May 04 19:05:26.268269 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 04 19:05:26.268949 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 04 19:05:26.269236 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 04 19:05:26.269633 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 04 19:05:26.269897 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 04 19:05:26.270292 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.270811 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.271201 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.271469 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.271802 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.272119 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.272442 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.272767 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.272921 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 04 19:05:26.273296 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.273394 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 04 19:05:26.273561 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.273761 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 04 19:05:26.273887 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.274139 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 04 19:05:26.274240 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-830901-3-iscsi {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.274408 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 04 19:05:26.274529 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.274809 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.274974 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.275153 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.275357 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.275572 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.275748 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.275923 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.276065 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.276214 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.276364 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.276513 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.276665 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.276839 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.277066 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.277201 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.277404 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.277580 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.277709 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.277829 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.278032 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.278150 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.278371 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-830901-3-iscsi {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.278484 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.279350 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.279470 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.279557 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.279639 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.279893 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.280019 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.280207 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.280322 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.280524 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.280634 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.280842 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.280975 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.281175 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.281274 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-830901-3-iscsi {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.281609 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.281813 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.281962 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.282093 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.282225 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.282343 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.282702 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.282882 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.283012 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.283139 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.283264 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.283391 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.283523 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.283649 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.284031 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.284326 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.284476 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.284610 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.284757 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.284897 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.285067 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.285200 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.285338 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.285557 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-830901-3-iscsi {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.285700 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.285825 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.285953 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.286085 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.286229 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.286375 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.286506 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.286635 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.286761 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.286890 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.287032 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.287175 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.287324 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.287458 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.287596 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.287734 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.287863 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.288042 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.288163 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.288367 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.288502 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.288691 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.288813 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.288946 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.289043 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.289200 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.289380 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.289597 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.289846 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.289985 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.290125 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.290271 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.290416 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.290564 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.290702 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.290832 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.290969 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.291107 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.291249 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.291400 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.291531 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.291668 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.291808 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.291944 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.292130 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.292259 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.292452 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.292561 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.292790 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.293029 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.293261 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.293511 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.293664 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.293797 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.293928 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.294078 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.294222 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.294366 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.69 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.294507 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.294650 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.69 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.294782 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.294930 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.295058 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.295197 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.295325 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.295461 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.295654 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.295807 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.295938 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.296073 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.296208 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.296339 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.296477 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.296619 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.296760 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.296905 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.297045 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.297186 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.297332 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.297544 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.297678 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.297809 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.297981 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.298129 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.298337 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.298458 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.69 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.298635 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.69 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.298759 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.298937 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.299047 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.299256 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.299351 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.299567 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.299668 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.299877 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.299984 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.300185 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.300285 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.300488 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.300589 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.300806 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.300988 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.301126 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.301267 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.301394 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.301552 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.301739 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.301878 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.302048 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.302185 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.302347 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.302477 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.302651 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.302797 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.302957 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.303098 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.303267 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.303404 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.303586 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.303731 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.303900 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.304033 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.304208 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.304344 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.304516 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.304660 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.304824 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.304966 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.305130 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.305280 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.305447 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.305621 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.305782 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.305941 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.306089 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.306225 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.306397 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.306492 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.306702 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.306794 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.307008 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.307126 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.307329 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.307459 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.307638 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.307782 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.307945 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.308114 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.308266 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.308457 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.308564 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.308837 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.308930 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.309063 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.309163 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.309377 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.309506 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.309717 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.309810 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.310074 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.310178 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.310395 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.310542 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.310700 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.310858 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.311035 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.311163 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.311347 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.311460 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.311653 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.311764 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.311954 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.312057 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.312280 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.312516 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.312731 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.312935 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.313068 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.313203 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.313345 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.313530 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.313530 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.313784 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.313910 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.314034 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.314165 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.314305 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.314435 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.314575 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.314806 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.314935 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.315067 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.315197 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.315341 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.315528 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.315667 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.315792 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.315926 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.316053 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.316266 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.316411 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.316606 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.316755 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.316904 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.317037 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.317142 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.317296 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.317455 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.317637 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.317792 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.317955 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.318108 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.318278 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.318437 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 19:05:26.318598 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.318790 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.318923 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.319134 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.319226 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.319491 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.319599 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.319818 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.319942 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.320161 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.320271 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.320483 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.320587 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.320815 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.320932 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.321137 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.321256 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.321456 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.321597 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.321817 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.321911 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.322143 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.322245 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.322468 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.322577 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.322794 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.322907 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.323116 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.323209 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.323433 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.323527 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.323747 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.323853 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.324061 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.324194 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.324389 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.324490 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.324720 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.324822 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.325034 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.325127 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.325357 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.325451 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.326212 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.326329 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.326530 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.326657 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.326849 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.327043 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.327203 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.327348 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.327502 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.327662 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.327799 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.327954 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.328114 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.328275 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.328434 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.328584 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.328726 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.328883 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.329043 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.329185 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.329330 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.329540 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.329659 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.329764 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.329977 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.330109 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.330291 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.330427 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.330600 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.330735 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.330911 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.331069 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.331211 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.331396 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.331528 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.331720 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.331851 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.332046 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.332177 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.332370 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.332501 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.332718 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.332851 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.333049 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.333182 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.333377 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.333545 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.333717 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.333852 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.334031 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.334164 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.334342 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.334485 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.334658 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.334793 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.334972 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.335103 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.335282 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.335428 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.335601 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.335737 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.335913 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.336043 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.336225 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.336390 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.336538 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.336672 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.336843 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.336995 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.337138 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.337331 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.337445 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.337576 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.337782 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.337875 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.338096 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.338199 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.338411 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.338504 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.338727 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.338826 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.339057 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.339160 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.339373 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.339465 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.339690 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.339782 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.340013 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.340104 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.340332 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.340433 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.340646 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.340738 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.340980 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.341128 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.341930 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.342056 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.342182 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.342321 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.342499 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.342641 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.342815 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.342954 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.343122 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.343264 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.343432 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.343562 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.343740 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.343871 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.344054 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.344201 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.344361 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.344502 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.344667 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.344815 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.344976 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.345126 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.345281 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.345420 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.345603 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.345718 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.345928 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.346079 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.346241 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.346380 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.346552 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.346697 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.346859 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.346989 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.347166 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.347362 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.347494 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.347632 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.347810 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.347954 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.348155 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.348307 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.348478 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.348621 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.348793 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.348930 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.349116 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.349245 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.349430 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.349639 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.349779 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.349870 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.350069 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.350161 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.350382 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.350486 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.350696 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.350786 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.351007 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.351146 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.351333 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.351439 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.351646 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.351745 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.351963 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.352054 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.352277 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.352380 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.352604 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.352697 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.352921 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.353013 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.353247 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.353347 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.353583 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.353692 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.353903 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.353996 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.354246 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.354354 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.354574 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.354673 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.354893 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.354991 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.355213 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.355305 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.355526 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.355624 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.355843 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.355936 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.356155 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.356249 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.356470 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.356625 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.356818 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.356923 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.357137 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.357230 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.357482 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.357580 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.357797 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.357888 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.358119 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.358221 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.358436 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.358596 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.358757 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.358876 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.359071 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.359209 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.359393 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.359502 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.359701 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.359805 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.360018 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.360110 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.360348 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.360442 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.360682 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.360792 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.360996 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.361096 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.361310 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.361409 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.361665 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.361779 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.361981 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.362121 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.362294 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.362396 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.362608 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.362702 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.362925 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.363052 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.363235 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.363349 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.363550 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.363655 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.363868 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.363966 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.364185 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.364290 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.364500 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.364599 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.364808 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.365126 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.365274 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.365432 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.365637 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.365762 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.365859 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.366068 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.366290 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.366577 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.366713 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.366858 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.366992 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.367089 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.367457 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.367672 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.367771 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.367854 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.367967 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.368241 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.368374 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.368508 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.368726 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.368957 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.369079 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.369315 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.369403 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.369545 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.369638 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.369868 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.369990 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.370092 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.370331 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.370510 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.370646 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.370776 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.370936 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.371077 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.371416 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.371735 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.371931 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.372190 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.372868 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.372982 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.373208 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.373537 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.373675 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.373779 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.373888 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.373980 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.374230 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.374453 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.374605 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.374852 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.375041 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.375164 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.375273 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.375563 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.375719 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.375835 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.376047 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.376206 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.376408 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.376549 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.376744 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.376907 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.377022 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.377273 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.377406 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.377562 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.377691 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.377967 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.378180 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.378385 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.378547 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.378710 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.378894 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.379088 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.379265 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.379533 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.379840 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.380078 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.380174 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.380256 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.380339 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.380602 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.380805 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.380957 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.381152 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.381274 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.381479 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.381652 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.381826 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.382025 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.382163 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.382500 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.382651 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.382748 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.382840 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.383026 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.383199 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.383338 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.383801 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.383921 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.383997 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.384084 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.384231 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.384417 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.384720 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.384874 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.384967 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.385184 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.385341 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.385763 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.385921 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.386077 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.386173 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.386339 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.386433 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.386604 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.386726 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.386822 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.386979 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.387194 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.387428 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.387586 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.387894 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.388047 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.388841 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.388998 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.389184 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.389509 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.389662 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.389812 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.389960 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.390182 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.390309 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.390494 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.390615 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.390807 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.390924 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.391136 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.391242 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.391445 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.391592 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.391733 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.391920 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.392054 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.392248 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.392532 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.392941 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.393118 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.393257 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.393429 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.393692 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.393862 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.394015 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.394158 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.394299 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.394440 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.394595 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.394743 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.394885 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.395027 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.395221 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.395382 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.395539 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.395649 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.395737 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.395870 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.395964 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.396182 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.396284 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.396490 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.396583 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.396797 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.396898 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.397110 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.397213 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.397421 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.397545 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.397753 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.397847 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.398067 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.398163 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.398374 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.398466 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.398688 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.398786 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.398999 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.399155 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.399301 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.399438 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.399614 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.399740 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.399927 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.400078 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.400288 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.400396 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.400541 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.400641 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.400869 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.400962 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.401184 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.401331 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.401522 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.401675 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.401814 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.401919 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.402132 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.402234 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.402439 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.402539 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.402748 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.402847 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.403060 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.403153 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.403384 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.403490 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.403741 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.403866 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.404049 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.404264 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.404357 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.404588 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.404681 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.404952 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.405053 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.405225 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.405327 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.405563 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.405660 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.405870 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.405961 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.406176 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.406284 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.406484 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.406576 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.406791 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.406884 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.407097 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.407203 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.407414 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.407509 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.407724 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.407815 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.408030 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.408133 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.408338 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.408430 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.408644 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.408745 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.408962 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.409071 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.409279 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.409385 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.409619 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.409731 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.409942 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.410056 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.410259 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.410376 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.410575 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.410680 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.410885 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.410978 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.411199 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.411298 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.411512 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.411611 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.411825 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.411924 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.412141 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.412240 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.412453 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.412553 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.412764 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.412856 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.413070 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.413163 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.413377 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.413506 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.413725 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.413819 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.414040 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.414143 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.414352 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.414457 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.414665 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.414764 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.414980 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.415072 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.415296 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.415402 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.415601 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.415700 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.415913 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.416005 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.416224 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.416316 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.416533 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.416624 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.416843 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.416933 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.417155 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.417255 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.417492 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.417587 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.417815 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.417925 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.418112 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.418213 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.418423 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.418513 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.418735 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.418833 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.419047 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.419142 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.419400 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.419559 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.419714 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.419835 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.420024 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.420158 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.420354 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.420466 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.420668 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.420782 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.420975 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.421086 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.421288 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.421391 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.421620 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.421739 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.421940 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.422045 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.422247 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.422359 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.422592 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.422704 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.422915 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.423009 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.423232 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.423326 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.423549 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.423670 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.423878 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.423973 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.424196 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.424288 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.424515 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.424608 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.424832 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.424931 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.425142 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.425236 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.425505 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.425615 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.425859 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.425954 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.426182 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.426276 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.426503 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.426602 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.426814 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.426906 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.427125 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.427218 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.427457 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.427552 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.427766 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.427869 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.428073 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.428175 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.428382 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.428483 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.428692 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.428786 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.429014 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.429119 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.429323 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.429443 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.429777 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.429947 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.430127 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.430305 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.430462 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.430616 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.430849 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.430995 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.431137 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.431294 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.431442 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.431590 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.431733 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.431900 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.432061 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.432212 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.432356 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.432505 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.432653 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.432816 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.432969 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.433119 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.433267 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.433409 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.433679 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.433839 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.433996 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.434142 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.434299 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.434445 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.434592 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.434727 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.435395 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.435533 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.435670 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.435811 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.436145 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.436310 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.436310 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.436592 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.436735 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.436890 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.437032 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.437182 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.437331 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.437491 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.437612 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.437701 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.437913 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.438030 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.438234 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.438328 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.438575 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.438677 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.438891 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.438992 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.439199 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.439298 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.439513 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.439627 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.439839 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.439988 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.440129 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.440223 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.440454 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.440562 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.440762 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.440876 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.441079 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.441192 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.441390 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.441511 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.441727 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.441925 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.442025 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.442249 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.442350 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.442569 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.442663 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.442903 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.443003 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.443237 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.443343 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.443548 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.443648 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.443873 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.443973 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.444197 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.444298 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.444503 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.444595 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.444828 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.444928 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.445141 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.445234 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.445449 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.445622 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.445778 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.445881 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.446086 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.446188 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.446422 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.446520 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.446727 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.446826 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.447050 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.447151 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.447381 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.447473 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.447715 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.447814 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.448032 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.448153 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.448365 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.448459 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.448694 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.448800 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.449014 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.449115 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.449336 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.449436 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.449691 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.449886 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.449986 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.450066 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.450299 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.450404 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.451198 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.451352 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.451536 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.451631 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.451844 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.451943 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.452157 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.452258 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.452476 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.452568 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.452781 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.452881 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.453089 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.453189 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.453397 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.453512 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.453751 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.453843 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.454061 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.454164 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.454385 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.454489 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.454698 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.454793 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.455006 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.455108 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.455314 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.455407 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.455622 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.455714 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.455964 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.456056 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.456269 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.456359 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.456587 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.456691 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.456902 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.456994 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.457218 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.457308 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.457571 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.457686 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.457890 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.457992 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.458221 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.458334 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.458544 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.458684 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.458865 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.459005 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.459187 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.459290 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.459506 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.459601 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.459825 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.459917 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.460144 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.460295 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.460464 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.460560 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.460776 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.460878 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.461096 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.461186 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.461414 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.461545 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.461755 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.461859 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.462071 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.462301 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.462405 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.462644 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.462738 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.462984 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.463078 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.463290 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.463390 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.463603 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.463704 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.463915 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.464014 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.464231 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.464332 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.464548 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.464647 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.464863 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.464956 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.465178 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.465273 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.465508 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.465616 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.465825 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.465928 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.466163 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.466268 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.466509 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.466608 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.466821 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.466926 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.467155 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.467248 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.467474 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.467574 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.467793 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.467902 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.468112 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.468238 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.468434 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.468579 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.468770 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.468874 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.469077 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.469170 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.469394 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.469502 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.469755 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.469848 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.470108 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.470213 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.470435 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.470542 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.470698 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.470800 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.471017 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.471118 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.471332 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.471440 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.471647 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.471751 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.471958 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.472050 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.472274 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.472381 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.472595 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.472813 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.472906 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.473153 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.473244 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.473512 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.473623 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.473819 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.473916 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.474139 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.474239 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.474464 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.474566 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.474786 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.474994 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.475110 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.475313 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.475433 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.475650 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.475743 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.475978 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.476071 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.476306 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.476400 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.476627 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.476729 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.476950 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.477050 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.477278 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.477373 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.477623 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.477721 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.477935 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.478038 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.478250 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.478342 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.478564 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.478670 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.478871 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.478973 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.479197 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.479297 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.479509 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.479601 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.479818 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.479921 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.480215 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.480321 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.480452 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.480555 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.480828 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.480987 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.481146 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.481341 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.481503 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.481693 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.481870 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.482050 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.482169 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.482384 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.482482 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.482705 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.482883 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.483021 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.483187 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.483336 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.483481 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.483636 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.483779 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.483939 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.484095 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.484262 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.484410 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.484568 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.484716 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.484865 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.484973 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.485169 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.485500 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.485621 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.485810 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.485925 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.486122 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.486292 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.486436 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.486592 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.486738 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.486880 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.487030 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.487172 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.487330 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.487474 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.487623 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.487773 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.487944 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.488098 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.488249 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.488402 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.488505 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.488678 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.488819 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.488999 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.489152 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.489301 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.489444 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.489732 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.489840 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.490035 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.490208 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.490384 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.490500 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.490653 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.490761 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.490969 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.491076 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.491275 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.491521 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.491623 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.491885 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.492056 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.492236 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.492331 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.495293 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.495426 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.495534 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.495638 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.495734 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.495821 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.495913 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.495998 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.496106 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.496208 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.496295 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.496386 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.496472 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.496564 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.496659 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.496746 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.496956 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.497056 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.497056 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.497211 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.497309 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.497935 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.498033 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.498118 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.498209 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.498294 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.498391 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.498484 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.498576 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.498716 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.498807 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.498899 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.498999 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.499085 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.499176 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.499261 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.499345 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.499438 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.499531 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.499624 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.499716 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.499802 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.499976 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.500085 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.500292 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.500386 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.500612 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.500718 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.500909 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.501034 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.501235 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.501341 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.501567 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.501666 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.501938 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.502047 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.502184 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.502286 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.502490 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.502584 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.502802 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.502903 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.503121 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.503300 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.503654 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.503772 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.503977 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.504076 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.504296 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.504397 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.504616 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.504717 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.504930 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.505028 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.505245 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.505367 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.505595 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.505734 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.505913 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.506043 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.506235 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.506358 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.506568 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.506702 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.506884 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.507093 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.507221 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.507450 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.507602 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.507799 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.507923 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.508135 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.508266 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.508483 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.508616 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.508826 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.508949 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.509147 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.509283 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.509516 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.509660 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.509804 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.509927 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.510128 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.510275 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.510445 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.510683 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.510835 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.510969 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.511101 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.511262 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.511473 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.511620 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.511762 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.512056 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.512209 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.512349 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.512491 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.512631 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.512771 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.512904 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.513632 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.513791 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.513970 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.514115 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.514293 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.514437 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.514617 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.514753 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.514942 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.515089 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.515325 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.515467 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.515634 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.515784 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.515941 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.516106 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.516243 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.516542 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.516692 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.516829 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.516943 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.517161 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.517319 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.517452 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.517896 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.518046 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.518189 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.518311 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.518450 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.518582 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.518715 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.518896 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.519042 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.519204 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.519339 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.519511 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.519655 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.519816 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.519953 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.520125 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.520469 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.520618 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.520778 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.520991 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.521136 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.521278 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.521411 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.521660 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.521879 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.522004 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.522137 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.522336 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.522482 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.522629 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.522771 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.522920 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.523045 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.523157 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.523287 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.523432 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.523555 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.523697 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.523872 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.524376 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.524472 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.524620 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.524734 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.524865 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.525005 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.525147 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.525287 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.525408 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.525643 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.525776 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.525995 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.526108 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.526632 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.526787 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.526930 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.527064 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.527179 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.527393 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.527616 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.527712 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.527795 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.527880 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.527979 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.528234 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.528346 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.528551 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.528672 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.528892 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.528986 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.529214 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.529350 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.529584 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.529722 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.529861 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.529988 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.530177 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.530299 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.530492 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.530602 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.530805 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.530916 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.531120 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.531234 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.531446 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.531639 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.531793 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.531958 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.532109 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.532253 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.532478 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.532634 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.532777 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.532930 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.533030 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.533124 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.533269 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.533488 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.533606 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.533835 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.533931 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.534154 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.534260 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.534470 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.534571 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.534782 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.534885 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.535032 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 04 19:05:26.535208 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.535542 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.535864 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.536196 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.536529 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.536858 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.537180 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.537549 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.537872 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.538197 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.538519 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.538841 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.539163 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.539483 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.539823 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.540162 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.540480 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.540817 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.541149 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.541501 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.541830 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.542153 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.542502 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.542831 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.543153 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.543479 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.543802 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.544126 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.544478 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.544807 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.545146 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.545501 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.545842 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.546180 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.546540 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.546864 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.547221 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.547561 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.547884 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.548208 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.548526 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 19:05:26.548781 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 04 19:05:26.558669 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_db.sqlalchemy.engines [None req-fc9dc0b5-fcf5-4067-b4b0-a49b557b0762 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117124) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 04 19:05:26.572560 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_db.sqlalchemy.engines [None req-95330065-db74-4817-84e4-af69dd6b1ede None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117125) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 04 19:05:26.625332 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.context [None req-fc9dc0b5-fcf5-4067-b4b0-a49b557b0762 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),86210640-9976-41e4-9a2e-686dd20f0fdb(cell1) {{(pid=117124) load_cells /opt/stack/nova/nova/context.py:464}} May 04 19:05:26.629802 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fc9dc0b5-fcf5-4067-b4b0-a49b557b0762 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:05:26.632573 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fc9dc0b5-fcf5-4067-b4b0-a49b557b0762 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:05:26.634071 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fc9dc0b5-fcf5-4067-b4b0-a49b557b0762 None None] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:05:26.637715 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.context [None req-95330065-db74-4817-84e4-af69dd6b1ede None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),86210640-9976-41e4-9a2e-686dd20f0fdb(cell1) {{(pid=117125) load_cells /opt/stack/nova/nova/context.py:464}} May 04 19:05:26.637877 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fc9dc0b5-fcf5-4067-b4b0-a49b557b0762 None None] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:05:26.643742 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-95330065-db74-4817-84e4-af69dd6b1ede None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:05:26.644742 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-95330065-db74-4817-84e4-af69dd6b1ede None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:05:26.645611 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-95330065-db74-4817-84e4-af69dd6b1ede None None] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:05:26.648286 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-95330065-db74-4817-84e4-af69dd6b1ede None None] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:05:26.653018 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_db.sqlalchemy.engines [None req-fc9dc0b5-fcf5-4067-b4b0-a49b557b0762 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117124) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 04 19:05:26.656256 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_db.sqlalchemy.engines [None req-fc9dc0b5-fcf5-4067-b4b0-a49b557b0762 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117124) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 04 19:05:26.661600 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_db.sqlalchemy.engines [None req-95330065-db74-4817-84e4-af69dd6b1ede None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117125) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 04 19:05:26.665924 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_db.sqlalchemy.engines [None req-95330065-db74-4817-84e4-af69dd6b1ede None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117125) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 04 19:05:26.824123 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_db.sqlalchemy.engines [None req-fc9dc0b5-fcf5-4067-b4b0-a49b557b0762 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117124) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 04 19:05:26.825928 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_db.sqlalchemy.engines [None req-95330065-db74-4817-84e4-af69dd6b1ede None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117125) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 04 19:05:27.152864 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: WARNING keystonemiddleware.auth_token [None req-95330065-db74-4817-84e4-af69dd6b1ede None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 04 19:05:27.160342 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: WARNING keystonemiddleware.auth_token [None req-95330065-db74-4817-84e4-af69dd6b1ede None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 04 19:05:27.166673 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: WARNING keystonemiddleware.auth_token [None req-fc9dc0b5-fcf5-4067-b4b0-a49b557b0762 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 04 19:05:27.173803 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: WARNING keystonemiddleware.auth_token [None req-fc9dc0b5-fcf5-4067-b4b0-a49b557b0762 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 04 19:05:27.513892 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: WARNING keystonemiddleware.auth_token [None req-95330065-db74-4817-84e4-af69dd6b1ede None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 04 19:05:27.519395 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: WARNING keystonemiddleware.auth_token [None req-95330065-db74-4817-84e4-af69dd6b1ede None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 04 19:05:27.524881 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a6b2d669c0 pid: 117125 (default app) May 04 19:05:27.525169 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: WARNING keystonemiddleware.auth_token [None req-fc9dc0b5-fcf5-4067-b4b0-a49b557b0762 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 04 19:05:27.530408 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: WARNING keystonemiddleware.auth_token [None req-fc9dc0b5-fcf5-4067-b4b0-a49b557b0762 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 04 19:05:27.535767 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a6b2d669c0 pid: 117124 (default app) May 04 19:06:09.731870 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-a053943f-4708-48cd-bcc9-deed81ed9fb7 tempest-VolumesGetTestJSON-1979451734 tempest-VolumesGetTestJSON-1979451734-project] Action: 'create', calling method: .version_select at 0x7fc3f8157d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-783265081", "metadata": {"Type": "work"}}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:06:10.661821 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-881ddbaf-531d-4575-b436-44d3c51000c9 tempest-VolumesNegativeTest-522760273 tempest-VolumesNegativeTest-522760273-project] Action: 'create', calling method: .version_select at 0x7fc3f8163940>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-955628169", "metadata": {"Type": "work"}}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:06:10.663590 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-881ddbaf-531d-4575-b436-44d3c51000c9 tempest-VolumesNegativeTest-522760273 tempest-VolumesNegativeTest-522760273-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 04 19:06:10.664536 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-881ddbaf-531d-4575-b436-44d3c51000c9 tempest-VolumesNegativeTest-522760273 tempest-VolumesNegativeTest-522760273-project] 10.222.0.69 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.453896 May 04 19:06:10.681858 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 1/1] 10.222.0.69 () {60 vars in 1155 bytes} [Wed May 4 19:06:09 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1474 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 04 19:06:10.689969 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-cf518461-a35a-430e-be0c-226a746833df tempest-VolumesNegativeTest-522760273 tempest-VolumesNegativeTest-522760273-project] Action: 'create', calling method: .version_select at 0x7fc3f80addc0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1609175882", "metadata": {"Type": "work"}}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:06:10.691600 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-cf518461-a35a-430e-be0c-226a746833df tempest-VolumesNegativeTest-522760273 tempest-VolumesNegativeTest-522760273-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 04 19:06:10.692353 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-cf518461-a35a-430e-be0c-226a746833df tempest-VolumesNegativeTest-522760273 tempest-VolumesNegativeTest-522760273-project] 10.222.0.69 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009277 May 04 19:06:10.694099 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 2/2] 10.222.0.69 () {60 vars in 1155 bytes} [Wed May 4 19:06:10 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 04 19:06:10.715187 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-0fdda34a-bf05-4e56-8b68-4857dfd483dc tempest-VolumesNegativeTest-522760273 tempest-VolumesNegativeTest-522760273-project] Action: 'create', calling method: .version_select at 0x7fc3f80adaf0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1100817414", "metadata": {"Type": "work"}}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:06:10.716395 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-0fdda34a-bf05-4e56-8b68-4857dfd483dc tempest-VolumesNegativeTest-522760273 tempest-VolumesNegativeTest-522760273-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 04 19:06:10.717208 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-0fdda34a-bf05-4e56-8b68-4857dfd483dc tempest-VolumesNegativeTest-522760273 tempest-VolumesNegativeTest-522760273-project] 10.222.0.69 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.014659 May 04 19:06:10.722216 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 3/3] 10.222.0.69 () {60 vars in 1155 bytes} [Wed May 4 19:06:10 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 04 19:06:10.727804 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-ab047aae-afec-4056-a81e-63457d582b3d tempest-VolumesNegativeTest-522760273 tempest-VolumesNegativeTest-522760273-project] Calling method '.version_select at 0x7fc3f8016af0>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:11.801791 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.wsgi [None req-ab047aae-afec-4056-a81e-63457d582b3d tempest-VolumesNegativeTest-522760273 tempest-VolumesNegativeTest-522760273-project] HTTP exception thrown: Volume tempest-invalid-1822993662 could not be found. May 04 19:06:11.802541 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-ab047aae-afec-4056-a81e-63457d582b3d tempest-VolumesNegativeTest-522760273 tempest-VolumesNegativeTest-522760273-project] Returning 404 to user: Volume tempest-invalid-1822993662 could not be found. {{(pid=117124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 04 19:06:11.803441 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-ab047aae-afec-4056-a81e-63457d582b3d tempest-VolumesNegativeTest-522760273 tempest-VolumesNegativeTest-522760273-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1822993662" status: 404 len: 99 microversion: 2.1 time: 1.080036 May 04 19:06:11.804286 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 4/4] 10.222.0.69 () {58 vars in 1217 bytes} [Wed May 4 19:06:10 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1822993662 => generated 99 bytes in 1081 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 04 19:06:11.815206 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-2ac32639-0ff1-4d47-8994-c383e2fc10b6 tempest-VolumesNegativeTest-522760273 tempest-VolumesNegativeTest-522760273-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004638 May 04 19:06:11.815973 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 5/5] 10.222.0.69 () {58 vars in 1139 bytes} [Wed May 4 19:06:11 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) May 04 19:06:11.828241 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-d8d8ce27-36d7-49f0-980a-d49c4654369c tempest-VolumesNegativeTest-522760273 tempest-VolumesNegativeTest-522760273-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006863 May 04 19:06:11.832009 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 6/6] 10.222.0.69 () {58 vars in 1136 bytes} [Wed May 4 19:06:11 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) May 04 19:06:11.850249 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-72b91e78-035a-4f41-aa99-8a78baa6a518 tempest-VolumesNegativeTest-522760273 tempest-VolumesNegativeTest-522760273-project] Calling method '.version_select at 0x7fc3f7f13430>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:12.012600 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-a053943f-4708-48cd-bcc9-deed81ed9fb7 tempest-VolumesGetTestJSON-1979451734 tempest-VolumesGetTestJSON-1979451734-project] 10.222.0.69 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.777644 May 04 19:06:12.013216 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 1/7] 10.222.0.69 () {60 vars in 1155 bytes} [Wed May 4 19:06:08 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3780 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 04 19:06:12.026701 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-b71c2488-deb1-49b2-9e3a-4182be844b51 tempest-VolumesGetTestJSON-1979451734 tempest-VolumesGetTestJSON-1979451734-project] Calling method '.version_select at 0x7fc3f7f67f70>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:12.045506 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.wsgi [None req-72b91e78-035a-4f41-aa99-8a78baa6a518 tempest-VolumesNegativeTest-522760273 tempest-VolumesNegativeTest-522760273-project] HTTP exception thrown: Volume 55d4b5e9-1600-4192-9d08-97430fe25694 could not be found. May 04 19:06:12.046340 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-72b91e78-035a-4f41-aa99-8a78baa6a518 tempest-VolumesNegativeTest-522760273 tempest-VolumesNegativeTest-522760273-project] Returning 404 to user: Volume 55d4b5e9-1600-4192-9d08-97430fe25694 could not be found. {{(pid=117124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 04 19:06:12.047447 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-72b91e78-035a-4f41-aa99-8a78baa6a518 tempest-VolumesNegativeTest-522760273 tempest-VolumesNegativeTest-522760273-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/55d4b5e9-1600-4192-9d08-97430fe25694" status: 404 len: 109 microversion: 2.1 time: 0.209878 May 04 19:06:12.047977 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 7/8] 10.222.0.69 () {58 vars in 1247 bytes} [Wed May 4 19:06:11 2022] DELETE /compute/v2.1/os-volumes/55d4b5e9-1600-4192-9d08-97430fe25694 => generated 109 bytes in 211 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 04 19:06:12.057548 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-09d9b581-d7f3-4b39-9388-d2a4d7abb0b4 tempest-VolumesNegativeTest-522760273 tempest-VolumesNegativeTest-522760273-project] Calling method '.version_select at 0x7fc3f7f131f0>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:12.313508 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-b71c2488-deb1-49b2-9e3a-4182be844b51 tempest-VolumesGetTestJSON-1979451734 tempest-VolumesGetTestJSON-1979451734-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/38975e26-ad46-42ff-9d93-ddc3c6c8b166" status: 200 len: 352 microversion: 2.1 time: 0.290915 May 04 19:06:12.315453 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 2/9] 10.222.0.69 () {58 vars in 1244 bytes} [Wed May 4 19:06:12 2022] GET /compute/v2.1/os-volumes/38975e26-ad46-42ff-9d93-ddc3c6c8b166 => generated 352 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:06:12.348881 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.wsgi [None req-09d9b581-d7f3-4b39-9388-d2a4d7abb0b4 tempest-VolumesNegativeTest-522760273 tempest-VolumesNegativeTest-522760273-project] HTTP exception thrown: Volume 24c88f34-e411-406e-86af-7936c90aa10d could not be found. May 04 19:06:12.350125 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-09d9b581-d7f3-4b39-9388-d2a4d7abb0b4 tempest-VolumesNegativeTest-522760273 tempest-VolumesNegativeTest-522760273-project] Returning 404 to user: Volume 24c88f34-e411-406e-86af-7936c90aa10d could not be found. {{(pid=117124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 04 19:06:12.351386 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-09d9b581-d7f3-4b39-9388-d2a4d7abb0b4 tempest-VolumesNegativeTest-522760273 tempest-VolumesNegativeTest-522760273-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/24c88f34-e411-406e-86af-7936c90aa10d" status: 404 len: 109 microversion: 2.1 time: 0.298166 May 04 19:06:12.362547 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 8/10] 10.222.0.69 () {58 vars in 1244 bytes} [Wed May 4 19:06:12 2022] GET /compute/v2.1/os-volumes/24c88f34-e411-406e-86af-7936c90aa10d => generated 109 bytes in 310 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 04 19:06:12.500979 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-0a914317-1dfd-43d1-bf62-7d02334005bf tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1358893289", "imageRef": "2869595e-cda4-45af-aaeb-0779eb5f4114", "flavorRef": "452", "networks": [{"uuid": "a3f1423c-778f-4484-a1f0-73c377da0184"}]}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:06:12.706089 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.network.neutron [None req-0a914317-1dfd-43d1-bf62-7d02334005bf tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] validate_networks() for [('a3f1423c-778f-4484-a1f0-73c377da0184', None, None, None, None, None)] {{(pid=117125) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 04 19:06:13.333441 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-fa447e7e-a05e-4b0f-b031-686f65597356 tempest-VolumesGetTestJSON-1979451734 tempest-VolumesGetTestJSON-1979451734-project] Calling method '.version_select at 0x7fc3f7f13d30>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:13.425835 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-fa447e7e-a05e-4b0f-b031-686f65597356 tempest-VolumesGetTestJSON-1979451734 tempest-VolumesGetTestJSON-1979451734-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/38975e26-ad46-42ff-9d93-ddc3c6c8b166" status: 200 len: 353 microversion: 2.1 time: 0.098931 May 04 19:06:13.430450 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 9/11] 10.222.0.69 () {58 vars in 1244 bytes} [Wed May 4 19:06:13 2022] GET /compute/v2.1/os-volumes/38975e26-ad46-42ff-9d93-ddc3c6c8b166 => generated 353 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:06:13.444815 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-9f306956-6387-4042-8572-0902f0996c9a tempest-VolumesGetTestJSON-1979451734 tempest-VolumesGetTestJSON-1979451734-project] Calling method '.version_select at 0x7fc3f7f13550>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:13.528611 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-9f306956-6387-4042-8572-0902f0996c9a tempest-VolumesGetTestJSON-1979451734 tempest-VolumesGetTestJSON-1979451734-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/38975e26-ad46-42ff-9d93-ddc3c6c8b166" status: 200 len: 353 microversion: 2.1 time: 0.089313 May 04 19:06:13.530659 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 10/12] 10.222.0.69 () {58 vars in 1244 bytes} [Wed May 4 19:06:13 2022] GET /compute/v2.1/os-volumes/38975e26-ad46-42ff-9d93-ddc3c6c8b166 => generated 353 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:06:13.543675 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-a348e303-9c15-4413-9732-c966c33b53fd tempest-VolumesGetTestJSON-1979451734 tempest-VolumesGetTestJSON-1979451734-project] Calling method '.version_select at 0x7fc3f7f285e0>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:13.675377 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-a348e303-9c15-4413-9732-c966c33b53fd tempest-VolumesGetTestJSON-1979451734 tempest-VolumesGetTestJSON-1979451734-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/38975e26-ad46-42ff-9d93-ddc3c6c8b166" status: 202 len: 0 microversion: 2.1 time: 0.136341 May 04 19:06:13.676042 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 11/13] 10.222.0.69 () {58 vars in 1247 bytes} [Wed May 4 19:06:13 2022] DELETE /compute/v2.1/os-volumes/38975e26-ad46-42ff-9d93-ddc3c6c8b166 => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 04 19:06:13.684933 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-4e0557cb-80b8-4b6e-846a-a4ba5db7b133 tempest-VolumesGetTestJSON-1979451734 tempest-VolumesGetTestJSON-1979451734-project] Calling method '.version_select at 0x7fc3f7f28ca0>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:13.837169 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-4e0557cb-80b8-4b6e-846a-a4ba5db7b133 tempest-VolumesGetTestJSON-1979451734 tempest-VolumesGetTestJSON-1979451734-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/38975e26-ad46-42ff-9d93-ddc3c6c8b166" status: 200 len: 352 microversion: 2.1 time: 0.155810 May 04 19:06:13.842734 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 12/14] 10.222.0.69 () {58 vars in 1244 bytes} [Wed May 4 19:06:13 2022] GET /compute/v2.1/os-volumes/38975e26-ad46-42ff-9d93-ddc3c6c8b166 => generated 352 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:06:14.425128 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-0a914317-1dfd-43d1-bf62-7d02334005bf tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Flavor limits 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 04 19:06:14.425796 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-0a914317-1dfd-43d1-bf62-7d02334005bf tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Image limits 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 04 19:06:14.426353 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-0a914317-1dfd-43d1-bf62-7d02334005bf tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Flavor pref 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 04 19:06:14.426813 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-0a914317-1dfd-43d1-bf62-7d02334005bf tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Image pref 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 04 19:06:14.427295 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-0a914317-1dfd-43d1-bf62-7d02334005bf tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 04 19:06:14.472255 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0a914317-1dfd-43d1-bf62-7d02334005bf tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:14.473132 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0a914317-1dfd-43d1-bf62-7d02334005bf tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:14.476437 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0a914317-1dfd-43d1-bf62-7d02334005bf tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:14.477225 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0a914317-1dfd-43d1-bf62-7d02334005bf tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:14.550783 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-0a914317-1dfd-43d1-bf62-7d02334005bf tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Getting quotas for project 2b6009c7f43b406e850c819b5b50311c. Resources: {'cores', 'ram', 'instances'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 04 19:06:14.568110 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-0a914317-1dfd-43d1-bf62-7d02334005bf tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Getting quotas for user 719edb67e8ae41b885581ae3645dd85b and project 2b6009c7f43b406e850c819b5b50311c. Resources: {'cores', 'ram', 'instances'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 04 19:06:14.600794 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-0a914317-1dfd-43d1-bf62-7d02334005bf tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Going to run 1 instances... {{(pid=117125) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 04 19:06:14.603859 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-0a914317-1dfd-43d1-bf62-7d02334005bf tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] [instance: 4c34ec07-a8d6-42d2-b843-d319612cfe2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2869595e-cda4-45af-aaeb-0779eb5f4114',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 04 19:06:14.753391 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-0a914317-1dfd-43d1-bf62-7d02334005bf tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.394697 May 04 19:06:14.754075 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 3/15] 10.222.0.69 () {60 vars in 1146 bytes} [Wed May 4 19:06:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 2396 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 04 19:06:14.766339 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-b2343cc9-d919-47aa-b942-bbf7e4822305 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:14.767292 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-b2343cc9-d919-47aa-b942-bbf7e4822305 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] [instance: 4c34ec07-a8d6-42d2-b843-d319612cfe2d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:14.858949 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-a5653879-5158-41f7-b572-cebd03276cbc tempest-VolumesGetTestJSON-1979451734 tempest-VolumesGetTestJSON-1979451734-project] Calling method '.version_select at 0x7fc3f7601c10>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:14.932501 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.wsgi [None req-a5653879-5158-41f7-b572-cebd03276cbc tempest-VolumesGetTestJSON-1979451734 tempest-VolumesGetTestJSON-1979451734-project] HTTP exception thrown: Volume 38975e26-ad46-42ff-9d93-ddc3c6c8b166 could not be found. May 04 19:06:14.933175 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-a5653879-5158-41f7-b572-cebd03276cbc tempest-VolumesGetTestJSON-1979451734 tempest-VolumesGetTestJSON-1979451734-project] Returning 404 to user: Volume 38975e26-ad46-42ff-9d93-ddc3c6c8b166 could not be found. {{(pid=117125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 04 19:06:14.934144 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-a5653879-5158-41f7-b572-cebd03276cbc tempest-VolumesGetTestJSON-1979451734 tempest-VolumesGetTestJSON-1979451734-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/38975e26-ad46-42ff-9d93-ddc3c6c8b166" status: 404 len: 109 microversion: 2.1 time: 0.088183 May 04 19:06:14.935144 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 4/16] 10.222.0.69 () {58 vars in 1244 bytes} [Wed May 4 19:06:14 2022] GET /compute/v2.1/os-volumes/38975e26-ad46-42ff-9d93-ddc3c6c8b166 => generated 109 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 04 19:06:15.190881 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-b2343cc9-d919-47aa-b942-bbf7e4822305 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719edb67e8ae41b885581ae3645dd85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6009c7f43b406e850c819b5b50311c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:15.212883 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-b2343cc9-d919-47aa-b942-bbf7e4822305 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] 10.222.0.69 "GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d" status: 200 len: 1215 microversion: 2.1 time: 0.452061 May 04 19:06:15.231611 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 13/17] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:06:14 2022] GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d => generated 1215 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:06:16.240350 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-19d2969c-f761-4220-ae1e-d4fc944f3818 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:16.241171 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-19d2969c-f761-4220-ae1e-d4fc944f3818 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] [instance: 4c34ec07-a8d6-42d2-b843-d319612cfe2d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:16.596299 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-19d2969c-f761-4220-ae1e-d4fc944f3818 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719edb67e8ae41b885581ae3645dd85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6009c7f43b406e850c819b5b50311c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:16.621414 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-19d2969c-f761-4220-ae1e-d4fc944f3818 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] 10.222.0.69 "GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d" status: 200 len: 1215 microversion: 2.1 time: 0.386019 May 04 19:06:16.622042 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 5/18] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:06:16 2022] GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d => generated 1215 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:06:17.639690 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-dacb0481-7d78-4185-8f39-bff1f6910f78 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:17.640988 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-dacb0481-7d78-4185-8f39-bff1f6910f78 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] [instance: 4c34ec07-a8d6-42d2-b843-d319612cfe2d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:17.659053 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-dacb0481-7d78-4185-8f39-bff1f6910f78 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:17.662755 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-dacb0481-7d78-4185-8f39-bff1f6910f78 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:17.665794 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-dacb0481-7d78-4185-8f39-bff1f6910f78 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:17.668777 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-dacb0481-7d78-4185-8f39-bff1f6910f78 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:18.016369 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-dacb0481-7d78-4185-8f39-bff1f6910f78 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719edb67e8ae41b885581ae3645dd85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6009c7f43b406e850c819b5b50311c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:18.044520 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-dacb0481-7d78-4185-8f39-bff1f6910f78 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] 10.222.0.69 "GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d" status: 200 len: 1219 microversion: 2.1 time: 0.410155 May 04 19:06:18.045243 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 14/19] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:06:17 2022] GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d => generated 1219 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:06:19.064152 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-5926984b-54bf-49b1-af99-3584dba29888 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:19.065574 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-5926984b-54bf-49b1-af99-3584dba29888 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] [instance: 4c34ec07-a8d6-42d2-b843-d319612cfe2d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:19.084464 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5926984b-54bf-49b1-af99-3584dba29888 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:19.092521 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5926984b-54bf-49b1-af99-3584dba29888 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:19.093597 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5926984b-54bf-49b1-af99-3584dba29888 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:19.099450 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5926984b-54bf-49b1-af99-3584dba29888 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:19.533783 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-5926984b-54bf-49b1-af99-3584dba29888 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719edb67e8ae41b885581ae3645dd85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6009c7f43b406e850c819b5b50311c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:19.566410 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-5926984b-54bf-49b1-af99-3584dba29888 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] 10.222.0.69 "GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d" status: 200 len: 1219 microversion: 2.1 time: 0.508545 May 04 19:06:19.578665 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 6/20] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:06:19 2022] GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d => generated 1219 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:06:20.371024 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-a7f6b30c-81fd-48da-b1bb-a39e32e38c12 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Action: 'create', calling method: .version_select at 0x7fc3f7e4eca0>, body: {"keypair": {"name": "tempest-keypair-284955437"}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:06:20.456126 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-a7f6b30c-81fd-48da-b1bb-a39e32e38c12 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Getting quotas for project e7beef313fe3439db0866cfdb10fdbe2. Resources: {'key_pairs'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 04 19:06:20.474132 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-a7f6b30c-81fd-48da-b1bb-a39e32e38c12 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Getting quotas for user 047fb46d1a764838bd8f8a44609a2e6f and project e7beef313fe3439db0866cfdb10fdbe2. Resources: {'key_pairs'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 04 19:06:20.583521 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-4faae6d5-ee4a-441c-86e0-8aafd63e9b7c tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:20.584837 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-4faae6d5-ee4a-441c-86e0-8aafd63e9b7c tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] [instance: 4c34ec07-a8d6-42d2-b843-d319612cfe2d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:20.597711 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4faae6d5-ee4a-441c-86e0-8aafd63e9b7c tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:20.598738 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4faae6d5-ee4a-441c-86e0-8aafd63e9b7c tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:20.599859 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4faae6d5-ee4a-441c-86e0-8aafd63e9b7c tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:20.600443 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4faae6d5-ee4a-441c-86e0-8aafd63e9b7c tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:20.796326 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-a7f6b30c-81fd-48da-b1bb-a39e32e38c12 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Getting quotas for project e7beef313fe3439db0866cfdb10fdbe2. Resources: {'key_pairs'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 04 19:06:20.811758 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-a7f6b30c-81fd-48da-b1bb-a39e32e38c12 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Getting quotas for user 047fb46d1a764838bd8f8a44609a2e6f and project e7beef313fe3439db0866cfdb10fdbe2. Resources: {'key_pairs'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 04 19:06:20.834243 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-a7f6b30c-81fd-48da-b1bb-a39e32e38c12 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 1.196557 May 04 19:06:20.840593 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 15/21] 10.222.0.69 () {62 vars in 1198 bytes} [Wed May 4 19:06:19 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 1199 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) May 04 19:06:21.295975 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-4faae6d5-ee4a-441c-86e0-8aafd63e9b7c tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719edb67e8ae41b885581ae3645dd85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6009c7f43b406e850c819b5b50311c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:21.306406 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-4faae6d5-ee4a-441c-86e0-8aafd63e9b7c tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] 10.222.0.69 "GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d" status: 200 len: 1267 microversion: 2.1 time: 0.725401 May 04 19:06:21.321230 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 7/22] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:06:20 2022] GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d => generated 1267 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:06:22.328498 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-df4ec6e7-611e-4bb0-a6a9-00121656bfcd tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:22.329781 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-df4ec6e7-611e-4bb0-a6a9-00121656bfcd tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] [instance: 4c34ec07-a8d6-42d2-b843-d319612cfe2d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:22.353807 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-df4ec6e7-611e-4bb0-a6a9-00121656bfcd tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:22.355473 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-df4ec6e7-611e-4bb0-a6a9-00121656bfcd tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:22.358935 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-df4ec6e7-611e-4bb0-a6a9-00121656bfcd tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:22.362199 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-df4ec6e7-611e-4bb0-a6a9-00121656bfcd tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:23.337805 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-0db53a5f-8d37-4cf8-a665-80be0ff6d06e tempest-VolumesTestJSON-1491027698 tempest-VolumesTestJSON-1491027698-project] Calling method '.version_select at 0x7fc3f6d4f310>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:23.565652 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-0db53a5f-8d37-4cf8-a665-80be0ff6d06e tempest-VolumesTestJSON-1491027698 tempest-VolumesTestJSON-1491027698-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/c4963975-5906-4c3a-a446-637802a2cdab" status: 200 len: 350 microversion: 2.1 time: 0.232044 May 04 19:06:23.566735 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 8/23] 10.222.0.69 () {58 vars in 1244 bytes} [Wed May 4 19:06:23 2022] GET /compute/v2.1/os-volumes/c4963975-5906-4c3a-a446-637802a2cdab => generated 350 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 04 19:06:23.848376 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-df4ec6e7-611e-4bb0-a6a9-00121656bfcd tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719edb67e8ae41b885581ae3645dd85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6009c7f43b406e850c819b5b50311c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:23.865653 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-df4ec6e7-611e-4bb0-a6a9-00121656bfcd tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] 10.222.0.69 "GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d" status: 200 len: 1273 microversion: 2.1 time: 1.539093 May 04 19:06:23.868101 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 16/24] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:06:22 2022] GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d => generated 1273 bytes in 1545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:06:24.885092 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-a69c0ccc-cb73-4173-a77d-dd97dc2ceb16 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:24.886443 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-a69c0ccc-cb73-4173-a77d-dd97dc2ceb16 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] [instance: 4c34ec07-a8d6-42d2-b843-d319612cfe2d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:24.904641 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a69c0ccc-cb73-4173-a77d-dd97dc2ceb16 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:24.910218 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a69c0ccc-cb73-4173-a77d-dd97dc2ceb16 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:24.917634 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a69c0ccc-cb73-4173-a77d-dd97dc2ceb16 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:24.925694 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a69c0ccc-cb73-4173-a77d-dd97dc2ceb16 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:25.644951 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-a69c0ccc-cb73-4173-a77d-dd97dc2ceb16 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719edb67e8ae41b885581ae3645dd85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6009c7f43b406e850c819b5b50311c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:25.656886 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-a69c0ccc-cb73-4173-a77d-dd97dc2ceb16 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] 10.222.0.69 "GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d" status: 200 len: 1273 microversion: 2.1 time: 0.776373 May 04 19:06:25.657497 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 9/25] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:06:24 2022] GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d => generated 1273 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:06:25.929563 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-fa377d0a-e8a3-4c45-9e11-40de59c1038f tempest-VolumesTestJSON-1491027698 tempest-VolumesTestJSON-1491027698-project] Calling method '.version_select at 0x7fc3f7ddef70>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:26.196943 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-fa377d0a-e8a3-4c45-9e11-40de59c1038f tempest-VolumesTestJSON-1491027698 tempest-VolumesTestJSON-1491027698-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/483c6b80-5fcb-4a99-a910-022daa9f8064" status: 200 len: 349 microversion: 2.1 time: 0.272927 May 04 19:06:26.197954 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 17/26] 10.222.0.69 () {58 vars in 1244 bytes} [Wed May 4 19:06:25 2022] GET /compute/v2.1/os-volumes/483c6b80-5fcb-4a99-a910-022daa9f8064 => generated 349 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:06:26.425791 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-4bff30be-65ec-48b0-a474-198b034f9074 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1098248482", "imageRef": "2869595e-cda4-45af-aaeb-0779eb5f4114", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3a2f1e63-50e7-4268-b40e-fc952c337bb5"}], "security_groups": [{"name": "tempest-securitygroup--407458113"}], "key_name": "tempest-keypair-284955437", "user_data": "}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:06:26.674082 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-88391a79-8348-4d02-bccf-8958c9b836a7 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:26.684059 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-88391a79-8348-4d02-bccf-8958c9b836a7 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] [instance: 4c34ec07-a8d6-42d2-b843-d319612cfe2d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:26.699744 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-88391a79-8348-4d02-bccf-8958c9b836a7 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:26.700450 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-88391a79-8348-4d02-bccf-8958c9b836a7 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:26.701381 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-88391a79-8348-4d02-bccf-8958c9b836a7 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:26.702008 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-88391a79-8348-4d02-bccf-8958c9b836a7 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:26.876077 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.network.neutron [None req-4bff30be-65ec-48b0-a474-198b034f9074 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] validate_networks() for [('3a2f1e63-50e7-4268-b40e-fc952c337bb5', None, None, None, None, None)] {{(pid=117125) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 04 19:06:27.086708 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-88391a79-8348-4d02-bccf-8958c9b836a7 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719edb67e8ae41b885581ae3645dd85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6009c7f43b406e850c819b5b50311c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:27.094396 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-88391a79-8348-4d02-bccf-8958c9b836a7 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] 10.222.0.69 "GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d" status: 200 len: 1273 microversion: 2.1 time: 0.424053 May 04 19:06:27.097133 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 18/27] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:06:26 2022] GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d => generated 1273 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:06:27.839753 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-4bff30be-65ec-48b0-a474-198b034f9074 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Flavor limits 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 04 19:06:27.841338 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-4bff30be-65ec-48b0-a474-198b034f9074 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Image limits 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 04 19:06:27.842271 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-4bff30be-65ec-48b0-a474-198b034f9074 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Flavor pref 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 04 19:06:27.842876 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-4bff30be-65ec-48b0-a474-198b034f9074 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Image pref 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 04 19:06:27.843731 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-4bff30be-65ec-48b0-a474-198b034f9074 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 04 19:06:27.861566 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4bff30be-65ec-48b0-a474-198b034f9074 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:27.862281 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4bff30be-65ec-48b0-a474-198b034f9074 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:27.864694 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4bff30be-65ec-48b0-a474-198b034f9074 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:27.865788 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4bff30be-65ec-48b0-a474-198b034f9074 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:27.895294 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-4bff30be-65ec-48b0-a474-198b034f9074 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Getting quotas for project e7beef313fe3439db0866cfdb10fdbe2. Resources: {'cores', 'ram', 'instances'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 04 19:06:27.901567 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-4bff30be-65ec-48b0-a474-198b034f9074 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Getting quotas for user 047fb46d1a764838bd8f8a44609a2e6f and project e7beef313fe3439db0866cfdb10fdbe2. Resources: {'cores', 'ram', 'instances'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 04 19:06:27.944032 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-4bff30be-65ec-48b0-a474-198b034f9074 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Going to run 1 instances... {{(pid=117125) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 04 19:06:27.951207 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-4bff30be-65ec-48b0-a474-198b034f9074 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2869595e-cda4-45af-aaeb-0779eb5f4114',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 04 19:06:28.111307 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-4bff30be-65ec-48b0-a474-198b034f9074 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.690424 May 04 19:06:28.114270 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-f8ee6f7e-31d6-49fd-aea2-2583b670af9c tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:28.114996 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-f8ee6f7e-31d6-49fd-aea2-2583b670af9c tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] [instance: 4c34ec07-a8d6-42d2-b843-d319612cfe2d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:28.121376 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 10/28] 10.222.0.69 () {62 vars in 1187 bytes} [Wed May 4 19:06:26 2022] POST /compute/v2.1/servers => generated 401 bytes in 1696 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 04 19:06:28.124574 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f8ee6f7e-31d6-49fd-aea2-2583b670af9c tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:28.125028 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f8ee6f7e-31d6-49fd-aea2-2583b670af9c tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:28.125835 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f8ee6f7e-31d6-49fd-aea2-2583b670af9c tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:28.126274 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f8ee6f7e-31d6-49fd-aea2-2583b670af9c tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:28.126677 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-27003195-f9a6-4bb8-936c-d87c01f384c9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:28.127290 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-27003195-f9a6-4bb8-936c-d87c01f384c9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:28.333965 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-27003195-f9a6-4bb8-936c-d87c01f384c9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:28.345855 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-27003195-f9a6-4bb8-936c-d87c01f384c9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:28.346762 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-27003195-f9a6-4bb8-936c-d87c01f384c9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:28.347902 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-27003195-f9a6-4bb8-936c-d87c01f384c9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1281 microversion: 2.20 time: 0.225410 May 04 19:06:28.355213 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 11/29] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:06:28 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1281 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 04 19:06:28.385041 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-688eeec3-c0b6-4766-89fb-70bddaebd969 tempest-VolumesTestJSON-1491027698 tempest-VolumesTestJSON-1491027698-project] Calling method '.version_select at 0x7fc3f6d21670>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:28.531907 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-688eeec3-c0b6-4766-89fb-70bddaebd969 tempest-VolumesTestJSON-1491027698 tempest-VolumesTestJSON-1491027698-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/bd93fc72-4208-449c-a9a0-e512824ac229" status: 200 len: 351 microversion: 2.1 time: 0.175011 May 04 19:06:28.533803 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 12/30] 10.222.0.69 () {58 vars in 1244 bytes} [Wed May 4 19:06:28 2022] GET /compute/v2.1/os-volumes/bd93fc72-4208-449c-a9a0-e512824ac229 => generated 351 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:06:28.547772 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-3ed480b9-ef66-4687-8190-2dd57f2600cd tempest-VolumesTestJSON-1491027698 tempest-VolumesTestJSON-1491027698-project] Calling method '.version_select at 0x7fc3f6d10b80>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:28.766507 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-f8ee6f7e-31d6-49fd-aea2-2583b670af9c tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719edb67e8ae41b885581ae3645dd85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6009c7f43b406e850c819b5b50311c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:28.784550 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-f8ee6f7e-31d6-49fd-aea2-2583b670af9c tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] 10.222.0.69 "GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d" status: 200 len: 1273 microversion: 2.1 time: 0.674272 May 04 19:06:28.798183 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 19/31] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:06:28 2022] GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d => generated 1273 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:06:28.801118 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-3ed480b9-ef66-4687-8190-2dd57f2600cd tempest-VolumesTestJSON-1491027698 tempest-VolumesTestJSON-1491027698-project] 10.222.0.69 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.257902 May 04 19:06:28.802380 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 13/32] 10.222.0.69 () {58 vars in 1133 bytes} [Wed May 4 19:06:28 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:06:28.814932 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-503f81f5-9d7a-4789-b1b4-6f8939b956e3 tempest-VolumesTestJSON-1491027698 tempest-VolumesTestJSON-1491027698-project] Calling method '.version_select at 0x7fc3f75b28b0>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:29.022938 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-503f81f5-9d7a-4789-b1b4-6f8939b956e3 tempest-VolumesTestJSON-1491027698 tempest-VolumesTestJSON-1491027698-project] 10.222.0.69 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.211390 May 04 19:06:29.023507 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 20/33] 10.222.0.69 () {58 vars in 1148 bytes} [Wed May 4 19:06:28 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:06:29.038998 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-8b7e3547-d41b-4842-b959-39c42a464f5d tempest-VolumesTestJSON-1491027698 tempest-VolumesTestJSON-1491027698-project] Calling method '.version_select at 0x7fc3f6db7670>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:29.224110 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-8b7e3547-d41b-4842-b959-39c42a464f5d tempest-VolumesTestJSON-1491027698 tempest-VolumesTestJSON-1491027698-project] 10.222.0.69 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.192243 May 04 19:06:29.224723 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 14/34] 10.222.0.69 () {58 vars in 1133 bytes} [Wed May 4 19:06:29 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:06:29.241310 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-6d458777-e9cf-4310-8cd8-bf2b2a6774d5 tempest-VolumesTestJSON-1491027698 tempest-VolumesTestJSON-1491027698-project] Calling method '.version_select at 0x7fc3f7547700>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:29.373183 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-17d78eb9-e304-4e78-aef6-cc30b6f780d9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:29.374185 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-17d78eb9-e304-4e78-aef6-cc30b6f780d9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:29.469817 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-6d458777-e9cf-4310-8cd8-bf2b2a6774d5 tempest-VolumesTestJSON-1491027698 tempest-VolumesTestJSON-1491027698-project] 10.222.0.69 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.232568 May 04 19:06:29.470505 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 21/35] 10.222.0.69 () {58 vars in 1166 bytes} [Wed May 4 19:06:29 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 352 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:06:29.484465 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-79472cf1-e087-41eb-b479-f1cfa179700c tempest-VolumesTestJSON-1491027698 tempest-VolumesTestJSON-1491027698-project] Calling method '.version_select at 0x7fc3f75a2040>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:29.546897 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-17d78eb9-e304-4e78-aef6-cc30b6f780d9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:29.556454 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-17d78eb9-e304-4e78-aef6-cc30b6f780d9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:29.558585 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-17d78eb9-e304-4e78-aef6-cc30b6f780d9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:29.559721 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-17d78eb9-e304-4e78-aef6-cc30b6f780d9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1281 microversion: 2.20 time: 0.191534 May 04 19:06:29.560279 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 15/36] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:06:29 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1281 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 04 19:06:29.609979 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-79472cf1-e087-41eb-b479-f1cfa179700c tempest-VolumesTestJSON-1491027698 tempest-VolumesTestJSON-1491027698-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.129217 May 04 19:06:29.618850 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 22/37] 10.222.0.69 () {58 vars in 1169 bytes} [Wed May 4 19:06:29 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:06:29.625255 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-4b0f9179-2528-4139-bc99-40155418d588 tempest-VolumesTestJSON-1491027698 tempest-VolumesTestJSON-1491027698-project] Calling method '.version_select at 0x7fc3f6dc65e0>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:29.788569 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-4b0f9179-2528-4139-bc99-40155418d588 tempest-VolumesTestJSON-1491027698 tempest-VolumesTestJSON-1491027698-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.167387 May 04 19:06:29.789594 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 16/38] 10.222.0.69 () {58 vars in 1154 bytes} [Wed May 4 19:06:29 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:06:29.806564 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-d8236341-b48d-4f6f-96cc-bc133f933250 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:29.807268 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-d8236341-b48d-4f6f-96cc-bc133f933250 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] [instance: 4c34ec07-a8d6-42d2-b843-d319612cfe2d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:29.813746 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-e0b7ce68-be5c-4ed0-953c-f5d2c023f133 tempest-VolumesTestJSON-1491027698 tempest-VolumesTestJSON-1491027698-project] Calling method '.version_select at 0x7fc3f75479d0>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:29.835767 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d8236341-b48d-4f6f-96cc-bc133f933250 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:29.836327 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d8236341-b48d-4f6f-96cc-bc133f933250 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:29.837274 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d8236341-b48d-4f6f-96cc-bc133f933250 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:29.840253 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d8236341-b48d-4f6f-96cc-bc133f933250 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:29.942942 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-e0b7ce68-be5c-4ed0-953c-f5d2c023f133 tempest-VolumesTestJSON-1491027698 tempest-VolumesTestJSON-1491027698-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.145443 May 04 19:06:29.943242 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-d8236341-b48d-4f6f-96cc-bc133f933250 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719edb67e8ae41b885581ae3645dd85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6009c7f43b406e850c819b5b50311c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:29.944126 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 23/39] 10.222.0.69 () {58 vars in 1187 bytes} [Wed May 4 19:06:29 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 352 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:06:29.954634 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-d8236341-b48d-4f6f-96cc-bc133f933250 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] 10.222.0.69 "GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d" status: 200 len: 1273 microversion: 2.1 time: 0.151975 May 04 19:06:29.955670 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 17/40] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:06:29 2022] GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d => generated 1273 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:06:29.956741 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-aab2c074-f74a-4e51-9283-303d2057e5ec tempest-VolumesTestJSON-1491027698 tempest-VolumesTestJSON-1491027698-project] Calling method '.version_select at 0x7fc3f7547e50>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:30.116366 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-aab2c074-f74a-4e51-9283-303d2057e5ec tempest-VolumesTestJSON-1491027698 tempest-VolumesTestJSON-1491027698-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.163626 May 04 19:06:30.116956 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 24/41] 10.222.0.69 () {58 vars in 1154 bytes} [Wed May 4 19:06:29 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:06:30.577938 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-a564fdce-a4bb-4d86-845e-2e4b46470d4f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:30.579408 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-a564fdce-a4bb-4d86-845e-2e4b46470d4f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:30.597063 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a564fdce-a4bb-4d86-845e-2e4b46470d4f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:30.599972 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a564fdce-a4bb-4d86-845e-2e4b46470d4f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:30.601619 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a564fdce-a4bb-4d86-845e-2e4b46470d4f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:30.603331 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a564fdce-a4bb-4d86-845e-2e4b46470d4f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:30.702836 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-a564fdce-a4bb-4d86-845e-2e4b46470d4f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:30.713334 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-a564fdce-a4bb-4d86-845e-2e4b46470d4f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:30.715609 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-a564fdce-a4bb-4d86-845e-2e4b46470d4f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:30.716983 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-a564fdce-a4bb-4d86-845e-2e4b46470d4f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1285 microversion: 2.20 time: 0.142934 May 04 19:06:30.718078 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 18/42] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:06:30 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1285 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:06:30.978102 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-69c6976c-2b90-4f18-9f4e-9000691d32b2 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:30.978739 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-69c6976c-2b90-4f18-9f4e-9000691d32b2 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] [instance: 4c34ec07-a8d6-42d2-b843-d319612cfe2d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:31.011931 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-69c6976c-2b90-4f18-9f4e-9000691d32b2 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:31.012477 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-69c6976c-2b90-4f18-9f4e-9000691d32b2 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:31.014037 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-69c6976c-2b90-4f18-9f4e-9000691d32b2 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:31.015012 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-69c6976c-2b90-4f18-9f4e-9000691d32b2 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:31.692758 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-69c6976c-2b90-4f18-9f4e-9000691d32b2 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719edb67e8ae41b885581ae3645dd85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6009c7f43b406e850c819b5b50311c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:31.719659 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-69c6976c-2b90-4f18-9f4e-9000691d32b2 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] 10.222.0.69 "GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d" status: 200 len: 1315 microversion: 2.1 time: 0.746201 May 04 19:06:31.734359 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 25/43] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:06:30 2022] GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d => generated 1315 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:06:32.265025 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-da802e60-557d-4ddc-ad15-c7b727647905 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-966532693", "imageRef": "2869595e-cda4-45af-aaeb-0779eb5f4114", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:06:32.288487 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-935dc79b-8d46-4e0a-b488-c654d4851125 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Action: 'create', calling method: .version_select at 0x7fc3f7dde5e0>, body: {"keypair": {"name": "tempest-keypair-894996204"}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:06:32.378805 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-935dc79b-8d46-4e0a-b488-c654d4851125 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Getting quotas for project df8f18c943e24a3ab621f08fa24c596b. Resources: {'key_pairs'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 04 19:06:32.404175 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-935dc79b-8d46-4e0a-b488-c654d4851125 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Getting quotas for user d54ad9809c8241a18d88fa6cd960badd and project df8f18c943e24a3ab621f08fa24c596b. Resources: {'key_pairs'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 04 19:06:32.409901 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.network.neutron [None req-da802e60-557d-4ddc-ad15-c7b727647905 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] validate_networks() for [('f77ad9c5-1b1c-436b-b024-d2a34457a300', None, None, None, None, None)] {{(pid=117125) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 04 19:06:33.444400 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-935dc79b-8d46-4e0a-b488-c654d4851125 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Getting quotas for project df8f18c943e24a3ab621f08fa24c596b. Resources: {'key_pairs'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 04 19:06:33.469403 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-935dc79b-8d46-4e0a-b488-c654d4851125 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Getting quotas for user d54ad9809c8241a18d88fa6cd960badd and project df8f18c943e24a3ab621f08fa24c596b. Resources: {'key_pairs'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 04 19:06:33.519879 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-935dc79b-8d46-4e0a-b488-c654d4851125 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 1.783718 May 04 19:06:33.525174 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 26/44] 10.222.0.69 () {60 vars in 1157 bytes} [Wed May 4 19:06:31 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 1790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:06:33.537241 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-2b8efe5b-ea84-4c3d-8297-29bdb35e2403 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:33.545874 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-2b8efe5b-ea84-4c3d-8297-29bdb35e2403 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:33.571358 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2b8efe5b-ea84-4c3d-8297-29bdb35e2403 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:33.572560 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2b8efe5b-ea84-4c3d-8297-29bdb35e2403 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:33.576496 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2b8efe5b-ea84-4c3d-8297-29bdb35e2403 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:33.579684 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2b8efe5b-ea84-4c3d-8297-29bdb35e2403 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:33.931114 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-2b8efe5b-ea84-4c3d-8297-29bdb35e2403 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:33.939942 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-2b8efe5b-ea84-4c3d-8297-29bdb35e2403 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:33.941500 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-2b8efe5b-ea84-4c3d-8297-29bdb35e2403 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:33.947770 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-2b8efe5b-ea84-4c3d-8297-29bdb35e2403 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1339 microversion: 2.20 time: 0.421029 May 04 19:06:33.963098 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 27/45] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:06:33 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1339 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:06:33.968495 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-a535664d-d9db-4262-beb8-2aead217001b tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:33.969117 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-a535664d-d9db-4262-beb8-2aead217001b tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] [instance: 4c34ec07-a8d6-42d2-b843-d319612cfe2d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:34.001428 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a535664d-d9db-4262-beb8-2aead217001b tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:34.002062 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a535664d-d9db-4262-beb8-2aead217001b tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:34.002862 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a535664d-d9db-4262-beb8-2aead217001b tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:34.005347 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a535664d-d9db-4262-beb8-2aead217001b tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:34.319129 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-da802e60-557d-4ddc-ad15-c7b727647905 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Flavor limits 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 04 19:06:34.320352 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-da802e60-557d-4ddc-ad15-c7b727647905 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Image limits 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 04 19:06:34.321122 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-da802e60-557d-4ddc-ad15-c7b727647905 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Flavor pref 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 04 19:06:34.321716 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-da802e60-557d-4ddc-ad15-c7b727647905 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Image pref 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 04 19:06:34.322264 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-da802e60-557d-4ddc-ad15-c7b727647905 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 04 19:06:34.343398 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-da802e60-557d-4ddc-ad15-c7b727647905 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:34.346115 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-da802e60-557d-4ddc-ad15-c7b727647905 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:34.349189 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-da802e60-557d-4ddc-ad15-c7b727647905 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:34.350446 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-da802e60-557d-4ddc-ad15-c7b727647905 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:34.391060 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-da802e60-557d-4ddc-ad15-c7b727647905 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Getting quotas for project 5966de1f7fc9403087d0ec08be6a3085. Resources: {'cores', 'ram', 'instances'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 04 19:06:34.405125 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-da802e60-557d-4ddc-ad15-c7b727647905 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Getting quotas for user 47deb39e5d954424a4fb4e97375443f7 and project 5966de1f7fc9403087d0ec08be6a3085. Resources: {'cores', 'ram', 'instances'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 04 19:06:34.422909 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-da802e60-557d-4ddc-ad15-c7b727647905 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Going to run 1 instances... {{(pid=117125) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 04 19:06:34.425338 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-da802e60-557d-4ddc-ad15-c7b727647905 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 150304bb-d8d1-4c08-93b6-fc07c69fd846] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2869595e-cda4-45af-aaeb-0779eb5f4114',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 04 19:06:34.533798 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-da802e60-557d-4ddc-ad15-c7b727647905 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.357996 May 04 19:06:34.563628 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 19/46] 10.222.0.69 () {60 vars in 1146 bytes} [Wed May 4 19:06:31 2022] POST /compute/v2.1/servers => generated 383 bytes in 3390 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 04 19:06:34.590000 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-3614ed30-0711-4e45-8f65-ae0175781672 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:34.592180 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-3614ed30-0711-4e45-8f65-ae0175781672 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 150304bb-d8d1-4c08-93b6-fc07c69fd846] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:34.808820 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-3614ed30-0711-4e45-8f65-ae0175781672 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:34.827837 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-3614ed30-0711-4e45-8f65-ae0175781672 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846" status: 200 len: 1221 microversion: 2.1 time: 0.261841 May 04 19:06:34.837167 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 20/47] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:06:34 2022] GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846 => generated 1221 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:06:34.970095 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-2c6cbd0d-450e-433e-b949-baa49b0a06f1 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:34.971020 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-2c6cbd0d-450e-433e-b949-baa49b0a06f1 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:34.987314 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2c6cbd0d-450e-433e-b949-baa49b0a06f1 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:34.988149 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2c6cbd0d-450e-433e-b949-baa49b0a06f1 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:34.990768 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2c6cbd0d-450e-433e-b949-baa49b0a06f1 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:34.991405 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2c6cbd0d-450e-433e-b949-baa49b0a06f1 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:35.283262 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-2c6cbd0d-450e-433e-b949-baa49b0a06f1 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:35.310483 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-2c6cbd0d-450e-433e-b949-baa49b0a06f1 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:35.330978 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-2c6cbd0d-450e-433e-b949-baa49b0a06f1 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:35.337801 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-2c6cbd0d-450e-433e-b949-baa49b0a06f1 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1339 microversion: 2.20 time: 0.374721 May 04 19:06:35.341216 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 21/48] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:06:34 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1339 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:06:35.348741 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-a535664d-d9db-4262-beb8-2aead217001b tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719edb67e8ae41b885581ae3645dd85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6009c7f43b406e850c819b5b50311c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:35.395566 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-a535664d-d9db-4262-beb8-2aead217001b tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] 10.222.0.69 "GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d" status: 200 len: 1315 microversion: 2.1 time: 1.430638 May 04 19:06:35.405259 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 28/49] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:06:33 2022] GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d => generated 1315 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:06:35.592090 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-4a754f39-6bd4-4153-9929-d56135dc7469 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-224085895", "imageRef": "2869595e-cda4-45af-aaeb-0779eb5f4114", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:06:35.777931 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.network.neutron [None req-4a754f39-6bd4-4153-9929-d56135dc7469 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] validate_networks() for [('f77ad9c5-1b1c-436b-b024-d2a34457a300', None, None, None, None, None)] {{(pid=117125) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 04 19:06:36.358007 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-4dfdbc34-dea5-4fb5-a08b-a6658faa67f0 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:36.358723 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-4dfdbc34-dea5-4fb5-a08b-a6658faa67f0 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:36.395976 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4dfdbc34-dea5-4fb5-a08b-a6658faa67f0 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:36.403140 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4dfdbc34-dea5-4fb5-a08b-a6658faa67f0 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:36.414736 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4dfdbc34-dea5-4fb5-a08b-a6658faa67f0 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:36.415686 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4dfdbc34-dea5-4fb5-a08b-a6658faa67f0 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:36.809676 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-4dfdbc34-dea5-4fb5-a08b-a6658faa67f0 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:36.827017 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-4dfdbc34-dea5-4fb5-a08b-a6658faa67f0 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:36.832188 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-4dfdbc34-dea5-4fb5-a08b-a6658faa67f0 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:36.835022 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-4dfdbc34-dea5-4fb5-a08b-a6658faa67f0 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1339 microversion: 2.20 time: 0.481179 May 04 19:06:36.842426 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 29/50] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:06:36 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1339 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 04 19:06:36.867240 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-c1dfd575-7400-46a6-957d-8a02b78951bb tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:36.874217 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-c1dfd575-7400-46a6-957d-8a02b78951bb tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] [instance: 4c34ec07-a8d6-42d2-b843-d319612cfe2d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:36.899630 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c1dfd575-7400-46a6-957d-8a02b78951bb tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:36.903548 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c1dfd575-7400-46a6-957d-8a02b78951bb tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:36.904570 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c1dfd575-7400-46a6-957d-8a02b78951bb tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:36.911128 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c1dfd575-7400-46a6-957d-8a02b78951bb tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:37.647851 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-4a754f39-6bd4-4153-9929-d56135dc7469 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Flavor limits 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 04 19:06:37.648341 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-4a754f39-6bd4-4153-9929-d56135dc7469 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Image limits 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 04 19:06:37.649792 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-4a754f39-6bd4-4153-9929-d56135dc7469 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Flavor pref 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 04 19:06:37.650418 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-4a754f39-6bd4-4153-9929-d56135dc7469 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Image pref 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 04 19:06:37.663049 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-4a754f39-6bd4-4153-9929-d56135dc7469 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 04 19:06:37.693614 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4a754f39-6bd4-4153-9929-d56135dc7469 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:37.694073 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4a754f39-6bd4-4153-9929-d56135dc7469 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:37.699054 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4a754f39-6bd4-4153-9929-d56135dc7469 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:37.701248 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4a754f39-6bd4-4153-9929-d56135dc7469 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:37.784441 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-4a754f39-6bd4-4153-9929-d56135dc7469 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Getting quotas for project 5966de1f7fc9403087d0ec08be6a3085. Resources: {'cores', 'ram', 'instances'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 04 19:06:37.800959 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-4a754f39-6bd4-4153-9929-d56135dc7469 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Getting quotas for user 47deb39e5d954424a4fb4e97375443f7 and project 5966de1f7fc9403087d0ec08be6a3085. Resources: {'cores', 'ram', 'instances'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 04 19:06:37.847182 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-4a754f39-6bd4-4153-9929-d56135dc7469 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Going to run 1 instances... {{(pid=117125) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 04 19:06:37.855803 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-4a754f39-6bd4-4153-9929-d56135dc7469 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 4b5bd528-4bc3-4bf3-be31-89364096663f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2869595e-cda4-45af-aaeb-0779eb5f4114',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 04 19:06:37.947263 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-4a754f39-6bd4-4153-9929-d56135dc7469 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.358351 May 04 19:06:37.951644 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 22/51] 10.222.0.69 () {60 vars in 1146 bytes} [Wed May 4 19:06:35 2022] POST /compute/v2.1/servers => generated 383 bytes in 2364 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 04 19:06:37.974537 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-c2af1899-7832-4836-9f52-903044bc26e1 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:37.975996 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-c2af1899-7832-4836-9f52-903044bc26e1 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:37.983958 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-c1dfd575-7400-46a6-957d-8a02b78951bb tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719edb67e8ae41b885581ae3645dd85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6009c7f43b406e850c819b5b50311c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:37.993278 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-c1dfd575-7400-46a6-957d-8a02b78951bb tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] 10.222.0.69 "GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d" status: 200 len: 1315 microversion: 2.1 time: 1.147911 May 04 19:06:37.993920 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 30/52] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:06:36 2022] GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d => generated 1315 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:06:38.002753 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c2af1899-7832-4836-9f52-903044bc26e1 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:38.003400 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c2af1899-7832-4836-9f52-903044bc26e1 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:38.005823 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c2af1899-7832-4836-9f52-903044bc26e1 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:38.009926 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c2af1899-7832-4836-9f52-903044bc26e1 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:38.016172 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-c02c9d97-05d6-4d66-b433-afbe51dacc7d tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:38.018593 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-c02c9d97-05d6-4d66-b433-afbe51dacc7d tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 4b5bd528-4bc3-4bf3-be31-89364096663f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:38.381800 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-c02c9d97-05d6-4d66-b433-afbe51dacc7d tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:38.402760 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-c02c9d97-05d6-4d66-b433-afbe51dacc7d tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f" status: 200 len: 1221 microversion: 2.1 time: 0.406352 May 04 19:06:38.406325 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 31/53] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:06:37 2022] GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f => generated 1221 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:06:38.937400 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-85d2b175-aba3-462a-b21e-f073ec8cd7f9 req-51f7cdb1-5947-45a2-8c7a-aff99b207dc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c34ec07-a8d6-42d2-b843-d319612cfe2d", "tag": "84ae57cd-445d-48f4-a111-8b738c387bc3"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:06:38.955245 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-85d2b175-aba3-462a-b21e-f073ec8cd7f9 req-51f7cdb1-5947-45a2-8c7a-aff99b207dc4 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:38.955701 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-85d2b175-aba3-462a-b21e-f073ec8cd7f9 req-51f7cdb1-5947-45a2-8c7a-aff99b207dc4 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:39.004466 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-85d2b175-aba3-462a-b21e-f073ec8cd7f9 req-51f7cdb1-5947-45a2-8c7a-aff99b207dc4 service nova] Creating event network-changed:84ae57cd-445d-48f4-a111-8b738c387bc3 for instance 4c34ec07-a8d6-42d2-b843-d319612cfe2d on hv-cinder-83090 May 04 19:06:39.005216 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-85d2b175-aba3-462a-b21e-f073ec8cd7f9 req-51f7cdb1-5947-45a2-8c7a-aff99b207dc4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117124) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 04 19:06:39.007104 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8c5e00ee-08ce-4306-8391-8f1f03b7bb88 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:39.007918 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8c5e00ee-08ce-4306-8391-8f1f03b7bb88 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:39.008972 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8c5e00ee-08ce-4306-8391-8f1f03b7bb88 None None] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:39.009752 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8c5e00ee-08ce-4306-8391-8f1f03b7bb88 None None] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:39.020416 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.compute.rpcapi [None req-8c5e00ee-08ce-4306-8391-8f1f03b7bb88 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 04 19:06:39.021955 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8c5e00ee-08ce-4306-8391-8f1f03b7bb88 None None] Releasing lock "compute-rpcapi-router" {{(pid=117124) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 04 19:06:39.069860 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-8c5e00ee-08ce-4306-8391-8f1f03b7bb88 None None] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.296457 May 04 19:06:39.071697 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 32/54] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:06:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 04 19:06:39.079515 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-b3e0de3e-90e0-4d29-87f6-d81b15d8592e tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:39.091356 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-b3e0de3e-90e0-4d29-87f6-d81b15d8592e tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] [instance: 4c34ec07-a8d6-42d2-b843-d319612cfe2d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:39.111548 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b3e0de3e-90e0-4d29-87f6-d81b15d8592e tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:39.113432 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b3e0de3e-90e0-4d29-87f6-d81b15d8592e tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:39.114515 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b3e0de3e-90e0-4d29-87f6-d81b15d8592e tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:39.115172 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b3e0de3e-90e0-4d29-87f6-d81b15d8592e tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:39.539958 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-b3e0de3e-90e0-4d29-87f6-d81b15d8592e tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719edb67e8ae41b885581ae3645dd85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6009c7f43b406e850c819b5b50311c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:39.551648 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-b3e0de3e-90e0-4d29-87f6-d81b15d8592e tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] 10.222.0.69 "GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d" status: 200 len: 1315 microversion: 2.1 time: 0.477849 May 04 19:06:39.564262 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 33/55] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:06:39 2022] GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d => generated 1315 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:06:39.593584 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-46e8fcdc-bea1-4ffd-9b33-5d4c0218351f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:39.594601 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-46e8fcdc-bea1-4ffd-9b33-5d4c0218351f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 4b5bd528-4bc3-4bf3-be31-89364096663f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:39.615879 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-46e8fcdc-bea1-4ffd-9b33-5d4c0218351f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:39.618172 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-46e8fcdc-bea1-4ffd-9b33-5d4c0218351f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:39.620480 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-46e8fcdc-bea1-4ffd-9b33-5d4c0218351f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:39.621170 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-46e8fcdc-bea1-4ffd-9b33-5d4c0218351f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:39.658888 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-c2af1899-7832-4836-9f52-903044bc26e1 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:39.683185 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-c2af1899-7832-4836-9f52-903044bc26e1 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:39.694802 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-c2af1899-7832-4836-9f52-903044bc26e1 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:39.704167 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-c2af1899-7832-4836-9f52-903044bc26e1 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1406 microversion: 2.20 time: 1.748534 May 04 19:06:39.704860 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 23/56] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:06:37 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1406 bytes in 1753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:06:39.837427 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-46e8fcdc-bea1-4ffd-9b33-5d4c0218351f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:39.848436 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-46e8fcdc-bea1-4ffd-9b33-5d4c0218351f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f" status: 200 len: 1273 microversion: 2.1 time: 0.273287 May 04 19:06:39.863313 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 34/57] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:06:39 2022] GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f => generated 1273 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:06:40.580823 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-9066e727-0aaf-43a7-b971-dad4e6319e24 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:40.581698 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-9066e727-0aaf-43a7-b971-dad4e6319e24 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] [instance: 4c34ec07-a8d6-42d2-b843-d319612cfe2d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:40.597090 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9066e727-0aaf-43a7-b971-dad4e6319e24 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:40.598717 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9066e727-0aaf-43a7-b971-dad4e6319e24 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:40.602187 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9066e727-0aaf-43a7-b971-dad4e6319e24 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:40.602844 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9066e727-0aaf-43a7-b971-dad4e6319e24 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:40.736152 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-d1799ea3-24c1-4eca-9c51-99d67ac3035f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:40.737362 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-d1799ea3-24c1-4eca-9c51-99d67ac3035f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:40.779425 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d1799ea3-24c1-4eca-9c51-99d67ac3035f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:40.781584 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d1799ea3-24c1-4eca-9c51-99d67ac3035f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:40.783617 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d1799ea3-24c1-4eca-9c51-99d67ac3035f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:40.785584 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d1799ea3-24c1-4eca-9c51-99d67ac3035f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:41.412881 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-9066e727-0aaf-43a7-b971-dad4e6319e24 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719edb67e8ae41b885581ae3645dd85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6009c7f43b406e850c819b5b50311c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:41.430473 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-9066e727-0aaf-43a7-b971-dad4e6319e24 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] 10.222.0.69 "GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d" status: 200 len: 1315 microversion: 2.1 time: 0.856988 May 04 19:06:41.432540 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 24/58] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:06:40 2022] GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d => generated 1315 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:06:41.466243 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-cc9ba80f-ae69-40b7-9e41-91b523f88b5e tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:41.473573 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-cc9ba80f-ae69-40b7-9e41-91b523f88b5e tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 4b5bd528-4bc3-4bf3-be31-89364096663f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:41.510788 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cc9ba80f-ae69-40b7-9e41-91b523f88b5e tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:41.513548 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cc9ba80f-ae69-40b7-9e41-91b523f88b5e tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:41.514446 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cc9ba80f-ae69-40b7-9e41-91b523f88b5e tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:41.516971 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cc9ba80f-ae69-40b7-9e41-91b523f88b5e tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:41.866245 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-cc9ba80f-ae69-40b7-9e41-91b523f88b5e tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:41.876864 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-cc9ba80f-ae69-40b7-9e41-91b523f88b5e tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f" status: 200 len: 1279 microversion: 2.1 time: 0.439432 May 04 19:06:41.881850 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 25/59] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:06:41 2022] GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f => generated 1279 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:06:41.893957 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-6868a846-f7c3-4aa6-b01e-da1881d63b98 req-40dc2534-950b-4fed-853f-f194082a0491 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f929e9e-51bf-477a-877b-6c162202c7f5", "tag": "c2916343-9825-41ef-93c5-4b2dbc6d65a9"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:06:41.910549 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-d1799ea3-24c1-4eca-9c51-99d67ac3035f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:41.927037 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-d1799ea3-24c1-4eca-9c51-99d67ac3035f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:41.939299 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-d1799ea3-24c1-4eca-9c51-99d67ac3035f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:41.943948 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-d1799ea3-24c1-4eca-9c51-99d67ac3035f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1406 microversion: 2.20 time: 1.220885 May 04 19:06:41.944708 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 35/60] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:06:40 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1406 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:06:41.945670 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-6868a846-f7c3-4aa6-b01e-da1881d63b98 req-40dc2534-950b-4fed-853f-f194082a0491 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:41.946801 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-6868a846-f7c3-4aa6-b01e-da1881d63b98 req-40dc2534-950b-4fed-853f-f194082a0491 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:41.993853 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-6868a846-f7c3-4aa6-b01e-da1881d63b98 req-40dc2534-950b-4fed-853f-f194082a0491 service nova] Creating event network-changed:c2916343-9825-41ef-93c5-4b2dbc6d65a9 for instance 8f929e9e-51bf-477a-877b-6c162202c7f5 on hv-cinder-83090 May 04 19:06:41.995176 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-6868a846-f7c3-4aa6-b01e-da1881d63b98 req-40dc2534-950b-4fed-853f-f194082a0491 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117125) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 04 19:06:41.997237 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c67e73c2-eb3a-4cf0-98f8-dd334a50fff2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:41.997859 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c67e73c2-eb3a-4cf0-98f8-dd334a50fff2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:41.999276 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c67e73c2-eb3a-4cf0-98f8-dd334a50fff2 None None] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:42.000221 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c67e73c2-eb3a-4cf0-98f8-dd334a50fff2 None None] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:42.014153 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.compute.rpcapi [None req-c67e73c2-eb3a-4cf0-98f8-dd334a50fff2 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 04 19:06:42.015796 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c67e73c2-eb3a-4cf0-98f8-dd334a50fff2 None None] Releasing lock "compute-rpcapi-router" {{(pid=117125) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 04 19:06:42.054214 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-c67e73c2-eb3a-4cf0-98f8-dd334a50fff2 None None] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.170830 May 04 19:06:42.054997 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 26/61] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:06:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:06:42.448865 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-d8330085-2642-430c-bdff-81259b804c13 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:42.449508 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-d8330085-2642-430c-bdff-81259b804c13 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] [instance: 4c34ec07-a8d6-42d2-b843-d319612cfe2d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:42.459371 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d8330085-2642-430c-bdff-81259b804c13 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:42.459873 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d8330085-2642-430c-bdff-81259b804c13 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:42.460678 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d8330085-2642-430c-bdff-81259b804c13 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:42.464318 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d8330085-2642-430c-bdff-81259b804c13 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:42.854167 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-d8330085-2642-430c-bdff-81259b804c13 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719edb67e8ae41b885581ae3645dd85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6009c7f43b406e850c819b5b50311c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:42.861908 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-d8330085-2642-430c-bdff-81259b804c13 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] 10.222.0.69 "GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d" status: 200 len: 1315 microversion: 2.1 time: 0.417638 May 04 19:06:42.876274 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 36/62] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:06:42 2022] GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d => generated 1315 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:06:42.901390 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-07685323-01d5-4906-93b3-972d6c65ccd1 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:42.902832 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-07685323-01d5-4906-93b3-972d6c65ccd1 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 4b5bd528-4bc3-4bf3-be31-89364096663f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:42.926769 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-07685323-01d5-4906-93b3-972d6c65ccd1 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:42.927525 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-07685323-01d5-4906-93b3-972d6c65ccd1 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:42.928608 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-07685323-01d5-4906-93b3-972d6c65ccd1 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:42.929478 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-07685323-01d5-4906-93b3-972d6c65ccd1 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:42.962778 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-c41fb47a-e92a-4798-a140-85f0c7921cb6 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:42.964347 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-c41fb47a-e92a-4798-a140-85f0c7921cb6 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:42.975930 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c41fb47a-e92a-4798-a140-85f0c7921cb6 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:42.977916 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c41fb47a-e92a-4798-a140-85f0c7921cb6 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:42.978941 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c41fb47a-e92a-4798-a140-85f0c7921cb6 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:42.982162 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c41fb47a-e92a-4798-a140-85f0c7921cb6 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:43.076228 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-07685323-01d5-4906-93b3-972d6c65ccd1 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:43.083688 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-07685323-01d5-4906-93b3-972d6c65ccd1 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f" status: 200 len: 1279 microversion: 2.1 time: 0.191239 May 04 19:06:43.084714 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 27/63] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:06:42 2022] GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f => generated 1279 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:06:43.090076 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-e19dc11a-04fb-40e2-96b9-c648b725d60c tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-933456063", "imageRef": "2869595e-cda4-45af-aaeb-0779eb5f4114", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "10d3c238-2c90-40fe-8795-81f60cedf693"}], "security_groups": [{"name": "tempest-securitygroup--498132128"}], "key_name": "tempest-keypair-894996204", "user_data": "}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:06:43.238592 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-c41fb47a-e92a-4798-a140-85f0c7921cb6 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:43.248605 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-c41fb47a-e92a-4798-a140-85f0c7921cb6 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:43.250436 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-c41fb47a-e92a-4798-a140-85f0c7921cb6 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:43.251838 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-c41fb47a-e92a-4798-a140-85f0c7921cb6 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1406 microversion: 2.20 time: 0.293876 May 04 19:06:43.252920 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 37/64] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:06:42 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1406 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 04 19:06:43.273381 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.network.neutron [None req-e19dc11a-04fb-40e2-96b9-c648b725d60c tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] validate_networks() for [('10d3c238-2c90-40fe-8795-81f60cedf693', None, None, None, None, None)] {{(pid=117125) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 04 19:06:43.639732 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-4e80bd49-11dc-40ce-80fa-3c357bf61c0b req-d4b4ca08-d6bd-4e63-8a47-a9a8b3f4ea75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "150304bb-d8d1-4c08-93b6-fc07c69fd846", "tag": "ba9cc838-25e8-4a65-849a-ef79368d718d"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:06:43.658461 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-4e80bd49-11dc-40ce-80fa-3c357bf61c0b req-d4b4ca08-d6bd-4e63-8a47-a9a8b3f4ea75 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:43.658988 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-4e80bd49-11dc-40ce-80fa-3c357bf61c0b req-d4b4ca08-d6bd-4e63-8a47-a9a8b3f4ea75 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:43.688232 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-4e80bd49-11dc-40ce-80fa-3c357bf61c0b req-d4b4ca08-d6bd-4e63-8a47-a9a8b3f4ea75 service nova] Creating event network-changed:ba9cc838-25e8-4a65-849a-ef79368d718d for instance 150304bb-d8d1-4c08-93b6-fc07c69fd846 on hv-cinder-83090 May 04 19:06:43.697033 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-4e80bd49-11dc-40ce-80fa-3c357bf61c0b req-d4b4ca08-d6bd-4e63-8a47-a9a8b3f4ea75 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157938 May 04 19:06:43.716799 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 38/65] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:06:43.913878 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-c59bd192-8085-4db2-9303-18402e84a589 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:43.920042 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-c59bd192-8085-4db2-9303-18402e84a589 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] [instance: 4c34ec07-a8d6-42d2-b843-d319612cfe2d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:43.935921 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c59bd192-8085-4db2-9303-18402e84a589 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:43.936589 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c59bd192-8085-4db2-9303-18402e84a589 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:43.939498 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c59bd192-8085-4db2-9303-18402e84a589 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:43.939948 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c59bd192-8085-4db2-9303-18402e84a589 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:44.349111 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-e19dc11a-04fb-40e2-96b9-c648b725d60c tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Flavor limits 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 04 19:06:44.349617 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-e19dc11a-04fb-40e2-96b9-c648b725d60c tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Image limits 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 04 19:06:44.350014 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-e19dc11a-04fb-40e2-96b9-c648b725d60c tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Flavor pref 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 04 19:06:44.350426 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-e19dc11a-04fb-40e2-96b9-c648b725d60c tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Image pref 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 04 19:06:44.350833 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-e19dc11a-04fb-40e2-96b9-c648b725d60c tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 04 19:06:44.378868 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e19dc11a-04fb-40e2-96b9-c648b725d60c tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:44.379338 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e19dc11a-04fb-40e2-96b9-c648b725d60c tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:44.380180 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e19dc11a-04fb-40e2-96b9-c648b725d60c tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:44.380624 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e19dc11a-04fb-40e2-96b9-c648b725d60c tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:44.441307 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-e19dc11a-04fb-40e2-96b9-c648b725d60c tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Getting quotas for project df8f18c943e24a3ab621f08fa24c596b. Resources: {'cores', 'ram', 'instances'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 04 19:06:44.452565 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-e19dc11a-04fb-40e2-96b9-c648b725d60c tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Getting quotas for user d54ad9809c8241a18d88fa6cd960badd and project df8f18c943e24a3ab621f08fa24c596b. Resources: {'cores', 'ram', 'instances'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 04 19:06:44.499645 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-e19dc11a-04fb-40e2-96b9-c648b725d60c tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Going to run 1 instances... {{(pid=117125) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 04 19:06:44.503104 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-e19dc11a-04fb-40e2-96b9-c648b725d60c tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2869595e-cda4-45af-aaeb-0779eb5f4114',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 04 19:06:44.605436 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-e19dc11a-04fb-40e2-96b9-c648b725d60c tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.519342 May 04 19:06:44.606338 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 28/66] 10.222.0.69 () {60 vars in 1146 bytes} [Wed May 4 19:06:43 2022] POST /compute/v2.1/servers => generated 401 bytes in 1521 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 04 19:06:44.637583 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-3ff7befe-1791-42c4-9524-32fa3011fa61 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:44.638224 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-3ff7befe-1791-42c4-9524-32fa3011fa61 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 4b5bd528-4bc3-4bf3-be31-89364096663f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:44.657220 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3ff7befe-1791-42c4-9524-32fa3011fa61 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:44.657634 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3ff7befe-1791-42c4-9524-32fa3011fa61 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:44.670400 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3ff7befe-1791-42c4-9524-32fa3011fa61 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:44.671707 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3ff7befe-1791-42c4-9524-32fa3011fa61 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:44.918846 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-c59bd192-8085-4db2-9303-18402e84a589 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719edb67e8ae41b885581ae3645dd85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6009c7f43b406e850c819b5b50311c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:44.928652 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-c59bd192-8085-4db2-9303-18402e84a589 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] 10.222.0.69 "GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d" status: 200 len: 1315 microversion: 2.1 time: 1.031165 May 04 19:06:44.929738 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 39/67] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:06:43 2022] GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d => generated 1315 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:06:44.939617 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-d16d1e19-fd2f-4cdb-8519-2a087a866725 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:44.945873 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-3ff7befe-1791-42c4-9524-32fa3011fa61 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:44.953151 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-d16d1e19-fd2f-4cdb-8519-2a087a866725 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:44.959620 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d16d1e19-fd2f-4cdb-8519-2a087a866725 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:44.963445 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d16d1e19-fd2f-4cdb-8519-2a087a866725 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:44.964278 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d16d1e19-fd2f-4cdb-8519-2a087a866725 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:44.964725 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d16d1e19-fd2f-4cdb-8519-2a087a866725 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:44.994060 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-3ff7befe-1791-42c4-9524-32fa3011fa61 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f" status: 200 len: 1321 microversion: 2.1 time: 0.368297 May 04 19:06:44.998040 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 29/68] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:06:44 2022] GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f => generated 1321 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:06:45.005077 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-6aedc646-94df-4166-8d5d-01798ea1f4b1 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:45.021051 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-6aedc646-94df-4166-8d5d-01798ea1f4b1 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:45.190420 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-6aedc646-94df-4166-8d5d-01798ea1f4b1 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:45.201107 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-6aedc646-94df-4166-8d5d-01798ea1f4b1 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1236 microversion: 2.1 time: 0.200312 May 04 19:06:45.205885 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 30/69] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:06:44 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1236 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:06:45.383180 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-d16d1e19-fd2f-4cdb-8519-2a087a866725 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:45.398509 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-d16d1e19-fd2f-4cdb-8519-2a087a866725 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:45.400932 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-d16d1e19-fd2f-4cdb-8519-2a087a866725 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:45.405019 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-d16d1e19-fd2f-4cdb-8519-2a087a866725 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1406 microversion: 2.20 time: 0.472533 May 04 19:06:45.408152 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 40/70] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:06:44 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1406 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:06:45.594561 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-11e39b10-65f9-43db-afef-6953f0e196f6 req-d8af6d5b-fe8d-4acb-a8cf-27829164490e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b5bd528-4bc3-4bf3-be31-89364096663f", "tag": "e803e0ad-7898-4a32-9dc5-0d5f670b9816"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:06:45.612285 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-11e39b10-65f9-43db-afef-6953f0e196f6 req-d8af6d5b-fe8d-4acb-a8cf-27829164490e service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:45.612736 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-11e39b10-65f9-43db-afef-6953f0e196f6 req-d8af6d5b-fe8d-4acb-a8cf-27829164490e service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:45.638614 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-11e39b10-65f9-43db-afef-6953f0e196f6 req-d8af6d5b-fe8d-4acb-a8cf-27829164490e service nova] Creating event network-changed:e803e0ad-7898-4a32-9dc5-0d5f670b9816 for instance 4b5bd528-4bc3-4bf3-be31-89364096663f on hv-cinder-83090 May 04 19:06:45.651867 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-11e39b10-65f9-43db-afef-6953f0e196f6 req-d8af6d5b-fe8d-4acb-a8cf-27829164490e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062457 May 04 19:06:45.653494 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 31/71] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:06:45.949847 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-fe793afa-1a1f-430b-a1ed-02c6e73d1499 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:45.950462 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-fe793afa-1a1f-430b-a1ed-02c6e73d1499 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] [instance: 4c34ec07-a8d6-42d2-b843-d319612cfe2d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:45.969627 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fe793afa-1a1f-430b-a1ed-02c6e73d1499 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:45.970538 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fe793afa-1a1f-430b-a1ed-02c6e73d1499 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:45.971448 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fe793afa-1a1f-430b-a1ed-02c6e73d1499 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:45.971996 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fe793afa-1a1f-430b-a1ed-02c6e73d1499 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:46.015424 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-2a16ba06-51f9-49bc-b978-fee0b002ecb7 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:46.016189 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-2a16ba06-51f9-49bc-b978-fee0b002ecb7 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 4b5bd528-4bc3-4bf3-be31-89364096663f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:46.023770 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2a16ba06-51f9-49bc-b978-fee0b002ecb7 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:46.024519 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2a16ba06-51f9-49bc-b978-fee0b002ecb7 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:46.025623 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2a16ba06-51f9-49bc-b978-fee0b002ecb7 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:46.026261 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2a16ba06-51f9-49bc-b978-fee0b002ecb7 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:46.408576 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-2a16ba06-51f9-49bc-b978-fee0b002ecb7 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:46.419705 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-2a16ba06-51f9-49bc-b978-fee0b002ecb7 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f" status: 200 len: 1321 microversion: 2.1 time: 0.408371 May 04 19:06:46.435458 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 32/72] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:06:46 2022] GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f => generated 1321 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:06:46.442331 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-d284fc50-fc37-46bf-a807-cd3326f9835f tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:46.443169 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-d284fc50-fc37-46bf-a807-cd3326f9835f tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:46.450753 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d284fc50-fc37-46bf-a807-cd3326f9835f tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:46.451472 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d284fc50-fc37-46bf-a807-cd3326f9835f tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:46.452500 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d284fc50-fc37-46bf-a807-cd3326f9835f tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:46.453141 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d284fc50-fc37-46bf-a807-cd3326f9835f tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:46.636969 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-d284fc50-fc37-46bf-a807-cd3326f9835f tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:46.656253 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-d284fc50-fc37-46bf-a807-cd3326f9835f tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1296 microversion: 2.1 time: 0.218365 May 04 19:06:46.659627 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 33/73] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:06:46 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1296 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:06:46.676458 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-b8bcf747-6539-49b2-a62e-9781344cc462 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:46.678498 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-b8bcf747-6539-49b2-a62e-9781344cc462 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:46.703054 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-fe793afa-1a1f-430b-a1ed-02c6e73d1499 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719edb67e8ae41b885581ae3645dd85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6009c7f43b406e850c819b5b50311c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:46.714828 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-fe793afa-1a1f-430b-a1ed-02c6e73d1499 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] 10.222.0.69 "GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d" status: 200 len: 1315 microversion: 2.1 time: 0.770436 May 04 19:06:46.718096 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 41/74] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:06:45 2022] GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d => generated 1315 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:06:46.720797 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b8bcf747-6539-49b2-a62e-9781344cc462 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:46.721699 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b8bcf747-6539-49b2-a62e-9781344cc462 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:46.728169 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b8bcf747-6539-49b2-a62e-9781344cc462 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:46.729817 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b8bcf747-6539-49b2-a62e-9781344cc462 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:47.227655 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-b8bcf747-6539-49b2-a62e-9781344cc462 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:47.241785 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-b8bcf747-6539-49b2-a62e-9781344cc462 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:47.245789 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-b8bcf747-6539-49b2-a62e-9781344cc462 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:47.249921 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-b8bcf747-6539-49b2-a62e-9781344cc462 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1406 microversion: 2.20 time: 0.588398 May 04 19:06:47.256084 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 34/75] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:06:46 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1406 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:06:47.439104 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-5c147aa9-fbb3-458a-8d66-186756d08bcf tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:47.439845 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-5c147aa9-fbb3-458a-8d66-186756d08bcf tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 4b5bd528-4bc3-4bf3-be31-89364096663f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:47.450186 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5c147aa9-fbb3-458a-8d66-186756d08bcf tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:47.450720 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5c147aa9-fbb3-458a-8d66-186756d08bcf tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:47.452871 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5c147aa9-fbb3-458a-8d66-186756d08bcf tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:47.453767 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5c147aa9-fbb3-458a-8d66-186756d08bcf tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:47.482692 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-8ff8ad46-5d23-4d25-ac82-7928bafac0e6 req-72d5dcba-679c-4f2c-b911-1da7051023a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c34ec07-a8d6-42d2-b843-d319612cfe2d", "name": "network-vif-plugged", "status": "completed", "tag": "84ae57cd-445d-48f4-a111-8b738c387bc3"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:06:47.503762 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-8ff8ad46-5d23-4d25-ac82-7928bafac0e6 req-72d5dcba-679c-4f2c-b911-1da7051023a9 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:47.504230 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-8ff8ad46-5d23-4d25-ac82-7928bafac0e6 req-72d5dcba-679c-4f2c-b911-1da7051023a9 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:47.520162 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-8ff8ad46-5d23-4d25-ac82-7928bafac0e6 req-72d5dcba-679c-4f2c-b911-1da7051023a9 service nova] Creating event network-vif-plugged:84ae57cd-445d-48f4-a111-8b738c387bc3 for instance 4c34ec07-a8d6-42d2-b843-d319612cfe2d on hv-cinder-83090 May 04 19:06:47.525825 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-8ff8ad46-5d23-4d25-ac82-7928bafac0e6 req-72d5dcba-679c-4f2c-b911-1da7051023a9 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152180 May 04 19:06:47.529315 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 42/76] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:06:47.663472 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-5c147aa9-fbb3-458a-8d66-186756d08bcf tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:47.676717 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-137b3fdf-54e0-4c1d-a59e-6cc01ef288a7 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:47.677422 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-137b3fdf-54e0-4c1d-a59e-6cc01ef288a7 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:47.681299 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-5c147aa9-fbb3-458a-8d66-186756d08bcf tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f" status: 200 len: 1321 microversion: 2.1 time: 0.246317 May 04 19:06:47.686032 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-137b3fdf-54e0-4c1d-a59e-6cc01ef288a7 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:47.686524 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-137b3fdf-54e0-4c1d-a59e-6cc01ef288a7 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:47.687304 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-137b3fdf-54e0-4c1d-a59e-6cc01ef288a7 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:47.687744 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-137b3fdf-54e0-4c1d-a59e-6cc01ef288a7 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:47.690216 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 35/77] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:06:47 2022] GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f => generated 1321 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:06:47.735831 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-9283b557-3a2e-47ab-8794-ae6a80384dbb tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:47.736838 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-9283b557-3a2e-47ab-8794-ae6a80384dbb tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] [instance: 4c34ec07-a8d6-42d2-b843-d319612cfe2d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:47.745203 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9283b557-3a2e-47ab-8794-ae6a80384dbb tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:47.746005 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9283b557-3a2e-47ab-8794-ae6a80384dbb tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:47.747214 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9283b557-3a2e-47ab-8794-ae6a80384dbb tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:47.747884 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9283b557-3a2e-47ab-8794-ae6a80384dbb tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:47.763817 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-137b3fdf-54e0-4c1d-a59e-6cc01ef288a7 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:47.771916 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-137b3fdf-54e0-4c1d-a59e-6cc01ef288a7 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1294 microversion: 2.1 time: 0.098818 May 04 19:06:47.772038 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 43/78] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:06:47 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1294 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:06:47.894400 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-9283b557-3a2e-47ab-8794-ae6a80384dbb tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719edb67e8ae41b885581ae3645dd85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6009c7f43b406e850c819b5b50311c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:47.901926 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-9283b557-3a2e-47ab-8794-ae6a80384dbb tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] 10.222.0.69 "GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d" status: 200 len: 1315 microversion: 2.1 time: 0.170641 May 04 19:06:47.902644 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 36/79] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:06:47 2022] GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:06:48.274503 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-fff22615-c419-4dfd-9f95-6feda280da5f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:48.275736 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-fff22615-c419-4dfd-9f95-6feda280da5f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:48.282260 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fff22615-c419-4dfd-9f95-6feda280da5f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:48.282707 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fff22615-c419-4dfd-9f95-6feda280da5f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:48.283474 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fff22615-c419-4dfd-9f95-6feda280da5f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:48.283906 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fff22615-c419-4dfd-9f95-6feda280da5f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:48.444715 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-fff22615-c419-4dfd-9f95-6feda280da5f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:48.452787 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-fff22615-c419-4dfd-9f95-6feda280da5f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:48.454322 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-fff22615-c419-4dfd-9f95-6feda280da5f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:48.455468 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-fff22615-c419-4dfd-9f95-6feda280da5f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1406 microversion: 2.20 time: 0.187891 May 04 19:06:48.456031 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 44/80] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:06:48 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1406 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:06:48.700933 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-8fcc6f49-efbe-44be-a669-605fe09906e2 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:48.701397 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-8fcc6f49-efbe-44be-a669-605fe09906e2 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 4b5bd528-4bc3-4bf3-be31-89364096663f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:48.707011 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8fcc6f49-efbe-44be-a669-605fe09906e2 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:48.707457 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8fcc6f49-efbe-44be-a669-605fe09906e2 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:48.708243 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8fcc6f49-efbe-44be-a669-605fe09906e2 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:48.708683 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8fcc6f49-efbe-44be-a669-605fe09906e2 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:48.791322 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-1674c3a5-5833-486c-905f-b2d6a1d9e312 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:48.792910 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-1674c3a5-5833-486c-905f-b2d6a1d9e312 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:48.802432 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1674c3a5-5833-486c-905f-b2d6a1d9e312 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:48.803225 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1674c3a5-5833-486c-905f-b2d6a1d9e312 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:48.804211 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1674c3a5-5833-486c-905f-b2d6a1d9e312 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:48.805380 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1674c3a5-5833-486c-905f-b2d6a1d9e312 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:48.899326 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-1674c3a5-5833-486c-905f-b2d6a1d9e312 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:48.906500 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-8fcc6f49-efbe-44be-a669-605fe09906e2 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:48.909260 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-1674c3a5-5833-486c-905f-b2d6a1d9e312 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1294 microversion: 2.1 time: 0.124533 May 04 19:06:48.910707 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 45/81] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:06:48 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1294 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:06:48.919901 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-8fcc6f49-efbe-44be-a669-605fe09906e2 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f" status: 200 len: 1321 microversion: 2.1 time: 0.219373 May 04 19:06:48.919901 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 37/82] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:06:48 2022] GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f => generated 1321 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:06:48.919901 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-bdf2f916-77c2-4d10-8b4e-09c7fb9f7845 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:48.919901 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-bdf2f916-77c2-4d10-8b4e-09c7fb9f7845 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] [instance: 4c34ec07-a8d6-42d2-b843-d319612cfe2d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:48.928447 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-bdf2f916-77c2-4d10-8b4e-09c7fb9f7845 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:48.928899 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-bdf2f916-77c2-4d10-8b4e-09c7fb9f7845 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:48.929689 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-bdf2f916-77c2-4d10-8b4e-09c7fb9f7845 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:48.930318 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-bdf2f916-77c2-4d10-8b4e-09c7fb9f7845 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:49.122675 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-bdf2f916-77c2-4d10-8b4e-09c7fb9f7845 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719edb67e8ae41b885581ae3645dd85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6009c7f43b406e850c819b5b50311c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:49.130906 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-bdf2f916-77c2-4d10-8b4e-09c7fb9f7845 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] 10.222.0.69 "GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d" status: 200 len: 1315 microversion: 2.1 time: 0.214980 May 04 19:06:49.131696 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 38/83] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:06:48 2022] GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:06:49.477774 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-ca95a36b-6118-40f8-8a32-90a52edb3267 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:49.477774 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-ca95a36b-6118-40f8-8a32-90a52edb3267 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:49.481328 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ca95a36b-6118-40f8-8a32-90a52edb3267 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:49.481885 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ca95a36b-6118-40f8-8a32-90a52edb3267 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:49.482651 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ca95a36b-6118-40f8-8a32-90a52edb3267 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:49.483083 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ca95a36b-6118-40f8-8a32-90a52edb3267 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:49.846974 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-ca95a36b-6118-40f8-8a32-90a52edb3267 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:49.862028 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-ca95a36b-6118-40f8-8a32-90a52edb3267 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:49.863535 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-ca95a36b-6118-40f8-8a32-90a52edb3267 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:49.864654 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-ca95a36b-6118-40f8-8a32-90a52edb3267 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1406 microversion: 2.20 time: 0.394878 May 04 19:06:49.865208 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 46/84] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:06:49 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1406 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:06:49.927970 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-909e5408-6e68-40ef-8db6-14e9034cbd82 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:49.928732 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-909e5408-6e68-40ef-8db6-14e9034cbd82 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:49.935167 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-909e5408-6e68-40ef-8db6-14e9034cbd82 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:49.936313 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-909e5408-6e68-40ef-8db6-14e9034cbd82 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:49.936389 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-13b23249-1bab-4dee-a75a-23bd6fc6cb90 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:49.937391 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-909e5408-6e68-40ef-8db6-14e9034cbd82 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:49.937584 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-13b23249-1bab-4dee-a75a-23bd6fc6cb90 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 4b5bd528-4bc3-4bf3-be31-89364096663f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:49.938222 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-909e5408-6e68-40ef-8db6-14e9034cbd82 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:49.955630 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-13b23249-1bab-4dee-a75a-23bd6fc6cb90 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:49.956447 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-13b23249-1bab-4dee-a75a-23bd6fc6cb90 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:49.958709 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-13b23249-1bab-4dee-a75a-23bd6fc6cb90 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:49.961233 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-13b23249-1bab-4dee-a75a-23bd6fc6cb90 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:50.023910 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-909e5408-6e68-40ef-8db6-14e9034cbd82 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:50.034721 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-909e5408-6e68-40ef-8db6-14e9034cbd82 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1294 microversion: 2.1 time: 0.110616 May 04 19:06:50.035674 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 39/85] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:06:49 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1294 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:06:50.151279 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-4d446fc1-8b3e-4efe-ab31-f749483b468d tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:50.152151 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-4d446fc1-8b3e-4efe-ab31-f749483b468d tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] [instance: 4c34ec07-a8d6-42d2-b843-d319612cfe2d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:50.160913 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4d446fc1-8b3e-4efe-ab31-f749483b468d tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:50.162131 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4d446fc1-8b3e-4efe-ab31-f749483b468d tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:50.163034 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4d446fc1-8b3e-4efe-ab31-f749483b468d tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:50.163656 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4d446fc1-8b3e-4efe-ab31-f749483b468d tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:50.274300 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-13b23249-1bab-4dee-a75a-23bd6fc6cb90 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:50.284896 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-13b23249-1bab-4dee-a75a-23bd6fc6cb90 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f" status: 200 len: 1321 microversion: 2.1 time: 0.356025 May 04 19:06:50.286306 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 47/86] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:06:49 2022] GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f => generated 1321 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:06:50.401869 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-4d446fc1-8b3e-4efe-ab31-f749483b468d tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719edb67e8ae41b885581ae3645dd85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6009c7f43b406e850c819b5b50311c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:50.411639 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-4d446fc1-8b3e-4efe-ab31-f749483b468d tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] 10.222.0.69 "GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d" status: 200 len: 1315 microversion: 2.1 time: 0.266073 May 04 19:06:50.421456 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 40/87] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:06:50 2022] GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d => generated 1315 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:06:50.884121 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-01801e46-6cf8-409d-8196-12dfd72272fd tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:50.885850 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-01801e46-6cf8-409d-8196-12dfd72272fd tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:50.897236 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-01801e46-6cf8-409d-8196-12dfd72272fd tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:50.897981 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-01801e46-6cf8-409d-8196-12dfd72272fd tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:50.898878 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-01801e46-6cf8-409d-8196-12dfd72272fd tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:50.899540 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-01801e46-6cf8-409d-8196-12dfd72272fd tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:51.053792 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-6bc171ca-0717-4a1b-8932-992bbbc7d923 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:51.055564 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-6bc171ca-0717-4a1b-8932-992bbbc7d923 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:51.067112 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6bc171ca-0717-4a1b-8932-992bbbc7d923 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:51.067922 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6bc171ca-0717-4a1b-8932-992bbbc7d923 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:51.070049 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6bc171ca-0717-4a1b-8932-992bbbc7d923 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:51.072945 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6bc171ca-0717-4a1b-8932-992bbbc7d923 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:51.391444 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-01801e46-6cf8-409d-8196-12dfd72272fd tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:51.401334 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-01801e46-6cf8-409d-8196-12dfd72272fd tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:51.408462 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-01801e46-6cf8-409d-8196-12dfd72272fd tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:51.414409 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-01801e46-6cf8-409d-8196-12dfd72272fd tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1406 microversion: 2.20 time: 0.535356 May 04 19:06:51.415301 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 48/88] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:06:50 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1406 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:06:51.430824 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-804158cc-5359-462d-a2aa-adabe39825b9 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:51.432357 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-804158cc-5359-462d-a2aa-adabe39825b9 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 4b5bd528-4bc3-4bf3-be31-89364096663f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:51.446912 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-804158cc-5359-462d-a2aa-adabe39825b9 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:51.448272 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-804158cc-5359-462d-a2aa-adabe39825b9 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:51.449253 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-804158cc-5359-462d-a2aa-adabe39825b9 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:51.449943 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-804158cc-5359-462d-a2aa-adabe39825b9 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:51.505823 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-6bc171ca-0717-4a1b-8932-992bbbc7d923 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:51.515714 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-6bc171ca-0717-4a1b-8932-992bbbc7d923 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1361 microversion: 2.1 time: 0.465421 May 04 19:06:51.517123 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 41/89] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:06:51 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1361 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:06:51.525195 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-b52ebb38-5e60-44d1-882a-e6e777249462 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:51.526764 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-b52ebb38-5e60-44d1-882a-e6e777249462 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] [instance: 4c34ec07-a8d6-42d2-b843-d319612cfe2d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:51.533443 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b52ebb38-5e60-44d1-882a-e6e777249462 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:51.534150 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b52ebb38-5e60-44d1-882a-e6e777249462 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:51.535110 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b52ebb38-5e60-44d1-882a-e6e777249462 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:51.536204 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b52ebb38-5e60-44d1-882a-e6e777249462 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:51.802483 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-804158cc-5359-462d-a2aa-adabe39825b9 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:51.815092 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-804158cc-5359-462d-a2aa-adabe39825b9 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f" status: 200 len: 1321 microversion: 2.1 time: 0.398461 May 04 19:06:51.815686 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 49/90] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:06:51 2022] GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f => generated 1321 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:06:51.819907 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-b52ebb38-5e60-44d1-882a-e6e777249462 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719edb67e8ae41b885581ae3645dd85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6009c7f43b406e850c819b5b50311c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:51.829964 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-b52ebb38-5e60-44d1-882a-e6e777249462 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] 10.222.0.69 "GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d" status: 200 len: 1315 microversion: 2.1 time: 0.311330 May 04 19:06:51.830565 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 42/91] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:06:51 2022] GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d => generated 1315 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:06:52.090343 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-590d769f-9857-42e5-8fbc-b22bb61d56e7 req-34116b60-e101-4a40-b58f-2ae76c77a1f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "150304bb-d8d1-4c08-93b6-fc07c69fd846", "name": "network-vif-plugged", "status": "completed", "tag": "ba9cc838-25e8-4a65-849a-ef79368d718d"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:06:52.109695 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-590d769f-9857-42e5-8fbc-b22bb61d56e7 req-34116b60-e101-4a40-b58f-2ae76c77a1f4 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:52.110574 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-590d769f-9857-42e5-8fbc-b22bb61d56e7 req-34116b60-e101-4a40-b58f-2ae76c77a1f4 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:52.142955 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-590d769f-9857-42e5-8fbc-b22bb61d56e7 req-34116b60-e101-4a40-b58f-2ae76c77a1f4 service nova] Creating event network-vif-plugged:ba9cc838-25e8-4a65-849a-ef79368d718d for instance 150304bb-d8d1-4c08-93b6-fc07c69fd846 on hv-cinder-83090 May 04 19:06:52.156405 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-590d769f-9857-42e5-8fbc-b22bb61d56e7 req-34116b60-e101-4a40-b58f-2ae76c77a1f4 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073421 May 04 19:06:52.159212 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 50/92] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:06:52.433965 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-27c5188c-ce1f-43fe-a82e-533a58f7c723 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:52.434664 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-27c5188c-ce1f-43fe-a82e-533a58f7c723 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:52.450485 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-27c5188c-ce1f-43fe-a82e-533a58f7c723 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:52.451293 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-27c5188c-ce1f-43fe-a82e-533a58f7c723 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:52.455380 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-27c5188c-ce1f-43fe-a82e-533a58f7c723 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:52.457159 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-27c5188c-ce1f-43fe-a82e-533a58f7c723 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:52.539356 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-e23f4311-8fcc-401e-882a-72f3fe5d0ada tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:52.540666 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-e23f4311-8fcc-401e-882a-72f3fe5d0ada tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:52.551496 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e23f4311-8fcc-401e-882a-72f3fe5d0ada tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:52.552541 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e23f4311-8fcc-401e-882a-72f3fe5d0ada tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:52.554069 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e23f4311-8fcc-401e-882a-72f3fe5d0ada tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:52.555182 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e23f4311-8fcc-401e-882a-72f3fe5d0ada tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:52.972756 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-27c5188c-ce1f-43fe-a82e-533a58f7c723 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:52.998600 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-27c5188c-ce1f-43fe-a82e-533a58f7c723 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:53.020999 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-27c5188c-ce1f-43fe-a82e-533a58f7c723 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:53.021605 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-e23f4311-8fcc-401e-882a-72f3fe5d0ada tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:53.023249 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-27c5188c-ce1f-43fe-a82e-533a58f7c723 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1406 microversion: 2.20 time: 0.594159 May 04 19:06:53.029176 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-e23f4311-8fcc-401e-882a-72f3fe5d0ada tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1361 microversion: 2.1 time: 0.498715 May 04 19:06:53.036072 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 51/93] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:06:52 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1361 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:06:53.040072 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 43/94] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:06:52 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1406 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:06:53.046834 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-bcc4c8fd-e088-42a0-a32e-6b8a3c3c9d71 req-4f2db24a-5c77-499f-8aad-5314ab51a78f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d", "tag": "f2a67d60-fe59-49da-83ac-a36d263ffa54"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:06:53.052174 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-421c95e9-7588-4cba-a654-e336de7e80b1 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:53.052964 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-421c95e9-7588-4cba-a654-e336de7e80b1 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 4b5bd528-4bc3-4bf3-be31-89364096663f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:53.063931 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-bcc4c8fd-e088-42a0-a32e-6b8a3c3c9d71 req-4f2db24a-5c77-499f-8aad-5314ab51a78f service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:53.068601 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-bcc4c8fd-e088-42a0-a32e-6b8a3c3c9d71 req-4f2db24a-5c77-499f-8aad-5314ab51a78f service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:53.089885 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-bcc4c8fd-e088-42a0-a32e-6b8a3c3c9d71 req-4f2db24a-5c77-499f-8aad-5314ab51a78f service nova] Creating event network-changed:f2a67d60-fe59-49da-83ac-a36d263ffa54 for instance f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d on hv-cinder-83090 May 04 19:06:53.095909 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-421c95e9-7588-4cba-a654-e336de7e80b1 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:53.097610 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-421c95e9-7588-4cba-a654-e336de7e80b1 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:53.099461 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-bcc4c8fd-e088-42a0-a32e-6b8a3c3c9d71 req-4f2db24a-5c77-499f-8aad-5314ab51a78f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061989 May 04 19:06:53.103869 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-421c95e9-7588-4cba-a654-e336de7e80b1 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:53.104131 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 52/95] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:06:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:06:53.104733 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-421c95e9-7588-4cba-a654-e336de7e80b1 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:53.109945 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-5da298ce-a66f-49f7-abac-641a386defef tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:53.110959 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-5da298ce-a66f-49f7-abac-641a386defef tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] [instance: 4c34ec07-a8d6-42d2-b843-d319612cfe2d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:53.120206 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5da298ce-a66f-49f7-abac-641a386defef tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:53.121761 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5da298ce-a66f-49f7-abac-641a386defef tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:53.122849 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5da298ce-a66f-49f7-abac-641a386defef tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:53.123438 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5da298ce-a66f-49f7-abac-641a386defef tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:53.320502 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-5da298ce-a66f-49f7-abac-641a386defef tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719edb67e8ae41b885581ae3645dd85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6009c7f43b406e850c819b5b50311c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:53.327936 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-5da298ce-a66f-49f7-abac-641a386defef tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] 10.222.0.69 "GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d" status: 200 len: 1501 microversion: 2.1 time: 0.222571 May 04 19:06:53.329030 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 53/96] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:06:53 2022] GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d => generated 1501 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:06:53.343570 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-421c95e9-7588-4cba-a654-e336de7e80b1 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:53.352475 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-421c95e9-7588-4cba-a654-e336de7e80b1 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f" status: 200 len: 1321 microversion: 2.1 time: 0.308659 May 04 19:06:53.354066 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 44/97] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:06:53 2022] GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f => generated 1321 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:06:54.050411 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-9bc25235-0367-4a6f-a0e7-1160576f2347 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:54.051019 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-9bc25235-0367-4a6f-a0e7-1160576f2347 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:54.055083 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-85875acb-95e4-42d3-90c0-75523bb7578c tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:54.056741 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-85875acb-95e4-42d3-90c0-75523bb7578c tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:54.058151 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9bc25235-0367-4a6f-a0e7-1160576f2347 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:54.058595 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9bc25235-0367-4a6f-a0e7-1160576f2347 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:54.059417 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9bc25235-0367-4a6f-a0e7-1160576f2347 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:54.059848 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9bc25235-0367-4a6f-a0e7-1160576f2347 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:54.064775 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-85875acb-95e4-42d3-90c0-75523bb7578c tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:54.065488 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-85875acb-95e4-42d3-90c0-75523bb7578c tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:54.066712 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-85875acb-95e4-42d3-90c0-75523bb7578c tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:54.067332 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-85875acb-95e4-42d3-90c0-75523bb7578c tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:54.220633 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-9bc25235-0367-4a6f-a0e7-1160576f2347 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:54.224646 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-85875acb-95e4-42d3-90c0-75523bb7578c tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:54.229958 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-9bc25235-0367-4a6f-a0e7-1160576f2347 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:54.231612 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-9bc25235-0367-4a6f-a0e7-1160576f2347 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:54.233592 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-85875acb-95e4-42d3-90c0-75523bb7578c tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1361 microversion: 2.1 time: 0.184857 May 04 19:06:54.234025 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-9bc25235-0367-4a6f-a0e7-1160576f2347 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1406 microversion: 2.20 time: 0.189408 May 04 19:06:54.234731 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 54/98] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:06:54 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1406 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:06:54.239486 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-f8b303e6-7c67-42af-a228-8a39f8ddcf80 req-043a7662-1b62-4414-8da9-f221693612cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f929e9e-51bf-477a-877b-6c162202c7f5", "name": "network-vif-plugged", "status": "completed", "tag": "c2916343-9825-41ef-93c5-4b2dbc6d65a9"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:06:54.245274 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 45/99] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:06:54 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1361 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:06:54.250377 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-f8b303e6-7c67-42af-a228-8a39f8ddcf80 req-043a7662-1b62-4414-8da9-f221693612cc service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:54.250917 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-f8b303e6-7c67-42af-a228-8a39f8ddcf80 req-043a7662-1b62-4414-8da9-f221693612cc service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:54.270815 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-f8b303e6-7c67-42af-a228-8a39f8ddcf80 req-043a7662-1b62-4414-8da9-f221693612cc service nova] Creating event network-vif-plugged:c2916343-9825-41ef-93c5-4b2dbc6d65a9 for instance 8f929e9e-51bf-477a-877b-6c162202c7f5 on hv-cinder-83090 May 04 19:06:54.276420 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-f8b303e6-7c67-42af-a228-8a39f8ddcf80 req-043a7662-1b62-4414-8da9-f221693612cc service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039800 May 04 19:06:54.277356 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 55/100] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:06:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:06:54.373275 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-d5a0fb5f-5d8b-4782-bab1-480ae846a6c6 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:54.374098 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-d5a0fb5f-5d8b-4782-bab1-480ae846a6c6 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 4b5bd528-4bc3-4bf3-be31-89364096663f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:54.383101 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d5a0fb5f-5d8b-4782-bab1-480ae846a6c6 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:54.383471 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d5a0fb5f-5d8b-4782-bab1-480ae846a6c6 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:54.385005 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d5a0fb5f-5d8b-4782-bab1-480ae846a6c6 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:54.385688 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d5a0fb5f-5d8b-4782-bab1-480ae846a6c6 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:54.529863 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-d5a0fb5f-5d8b-4782-bab1-480ae846a6c6 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:54.537164 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-d5a0fb5f-5d8b-4782-bab1-480ae846a6c6 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f" status: 200 len: 1321 microversion: 2.1 time: 0.170233 May 04 19:06:54.537958 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 46/101] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:06:54 2022] GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:06:55.254443 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-027163ee-5950-45da-90f7-82e03dc6637d tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:55.255056 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-027163ee-5950-45da-90f7-82e03dc6637d tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:55.261316 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-98a6010c-5536-455b-8f65-79bf70c767cc tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:55.262153 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-98a6010c-5536-455b-8f65-79bf70c767cc tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:55.266096 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-027163ee-5950-45da-90f7-82e03dc6637d tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:55.268299 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-027163ee-5950-45da-90f7-82e03dc6637d tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:55.269124 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-027163ee-5950-45da-90f7-82e03dc6637d tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:55.269597 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-027163ee-5950-45da-90f7-82e03dc6637d tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:55.269807 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-98a6010c-5536-455b-8f65-79bf70c767cc tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:55.271164 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-98a6010c-5536-455b-8f65-79bf70c767cc tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:55.272430 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-98a6010c-5536-455b-8f65-79bf70c767cc tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:55.273029 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-98a6010c-5536-455b-8f65-79bf70c767cc tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:55.465148 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-027163ee-5950-45da-90f7-82e03dc6637d tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:55.468468 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-98a6010c-5536-455b-8f65-79bf70c767cc tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:55.472788 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-027163ee-5950-45da-90f7-82e03dc6637d tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1361 microversion: 2.1 time: 0.222584 May 04 19:06:55.473371 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 47/102] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:06:55 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1361 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:06:55.485089 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-98a6010c-5536-455b-8f65-79bf70c767cc tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:55.486688 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-98a6010c-5536-455b-8f65-79bf70c767cc tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:55.487828 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-98a6010c-5536-455b-8f65-79bf70c767cc tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1406 microversion: 2.20 time: 0.236840 May 04 19:06:55.488688 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 56/103] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:06:55 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1406 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:06:55.555648 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-7bc8e0ae-f3e1-456f-9dcc-e527aad8168f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:55.556293 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-7bc8e0ae-f3e1-456f-9dcc-e527aad8168f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 4b5bd528-4bc3-4bf3-be31-89364096663f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:55.562284 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7bc8e0ae-f3e1-456f-9dcc-e527aad8168f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:55.562736 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7bc8e0ae-f3e1-456f-9dcc-e527aad8168f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:55.563495 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7bc8e0ae-f3e1-456f-9dcc-e527aad8168f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:55.564169 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7bc8e0ae-f3e1-456f-9dcc-e527aad8168f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:55.731779 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-7bc8e0ae-f3e1-456f-9dcc-e527aad8168f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:55.745309 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-7bc8e0ae-f3e1-456f-9dcc-e527aad8168f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f" status: 200 len: 1321 microversion: 2.1 time: 0.192255 May 04 19:06:55.746790 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 48/104] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:06:55 2022] GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f => generated 1321 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:06:56.497731 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-ddcd0336-187d-4aba-85df-e45448c5f00b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:56.503200 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-ddcd0336-187d-4aba-85df-e45448c5f00b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:56.506690 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-30c1c658-4760-483a-aeb7-8a7cfeeac5ef tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:56.507941 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-30c1c658-4760-483a-aeb7-8a7cfeeac5ef tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:56.521704 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-30c1c658-4760-483a-aeb7-8a7cfeeac5ef tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:56.523983 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ddcd0336-187d-4aba-85df-e45448c5f00b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:56.524522 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ddcd0336-187d-4aba-85df-e45448c5f00b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:56.526837 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-30c1c658-4760-483a-aeb7-8a7cfeeac5ef tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:56.529214 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-30c1c658-4760-483a-aeb7-8a7cfeeac5ef tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:56.530964 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ddcd0336-187d-4aba-85df-e45448c5f00b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:56.531935 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-30c1c658-4760-483a-aeb7-8a7cfeeac5ef tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:56.538273 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ddcd0336-187d-4aba-85df-e45448c5f00b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:56.799675 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-30c1c658-4760-483a-aeb7-8a7cfeeac5ef tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:56.813414 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-30c1c658-4760-483a-aeb7-8a7cfeeac5ef tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:56.815182 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-30c1c658-4760-483a-aeb7-8a7cfeeac5ef tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:56.820694 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-30c1c658-4760-483a-aeb7-8a7cfeeac5ef tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1406 microversion: 2.20 time: 0.318250 May 04 19:06:56.822946 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 49/105] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:06:56 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1406 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:06:56.830180 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-e1626bfa-0cb7-43de-b9e3-7e729575f234 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:56.841849 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-e1626bfa-0cb7-43de-b9e3-7e729575f234 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 4b5bd528-4bc3-4bf3-be31-89364096663f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:56.852630 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e1626bfa-0cb7-43de-b9e3-7e729575f234 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:56.855235 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e1626bfa-0cb7-43de-b9e3-7e729575f234 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:56.856345 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e1626bfa-0cb7-43de-b9e3-7e729575f234 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:56.860709 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e1626bfa-0cb7-43de-b9e3-7e729575f234 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:56.867512 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-ddcd0336-187d-4aba-85df-e45448c5f00b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:56.875969 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-ddcd0336-187d-4aba-85df-e45448c5f00b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1361 microversion: 2.1 time: 0.384853 May 04 19:06:56.878131 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 57/106] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:06:56 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1361 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:06:56.985324 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-05b780f6-eb18-4335-9648-1fe4371db59b tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fe790e8b-f0a9-469e-9c9b-5aecf6bf480c"}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:06:56.986801 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-05b780f6-eb18-4335-9648-1fe4371db59b tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] [instance: 4c34ec07-a8d6-42d2-b843-d319612cfe2d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:57.004886 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-05b780f6-eb18-4335-9648-1fe4371db59b tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:57.005681 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-05b780f6-eb18-4335-9648-1fe4371db59b tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:57.007026 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-05b780f6-eb18-4335-9648-1fe4371db59b tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:57.007746 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-05b780f6-eb18-4335-9648-1fe4371db59b tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:57.094490 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-e1626bfa-0cb7-43de-b9e3-7e729575f234 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:57.102585 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-e1626bfa-0cb7-43de-b9e3-7e729575f234 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f" status: 200 len: 1321 microversion: 2.1 time: 0.278217 May 04 19:06:57.103142 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 50/107] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:06:56 2022] GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f => generated 1321 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:06:57.840815 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-5d30a82d-625c-49f5-8b39-13f161fae049 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:57.841444 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-5d30a82d-625c-49f5-8b39-13f161fae049 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:57.847145 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5d30a82d-625c-49f5-8b39-13f161fae049 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:57.847579 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5d30a82d-625c-49f5-8b39-13f161fae049 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:57.848333 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5d30a82d-625c-49f5-8b39-13f161fae049 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:57.848757 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5d30a82d-625c-49f5-8b39-13f161fae049 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:57.939165 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-05b780f6-eb18-4335-9648-1fe4371db59b tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] 10.222.0.69 "POST /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.961261 May 04 19:06:57.940925 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 58/108] 10.222.0.69 () {60 vars in 1322 bytes} [Wed May 4 19:06:56 2022] POST /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d/os-volume_attachments => generated 194 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 04 19:06:57.947877 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-3c84db25-5851-4d92-b061-31b3f0661430 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:57.949498 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-3c84db25-5851-4d92-b061-31b3f0661430 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:57.970647 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3c84db25-5851-4d92-b061-31b3f0661430 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:57.971336 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3c84db25-5851-4d92-b061-31b3f0661430 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:57.972391 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3c84db25-5851-4d92-b061-31b3f0661430 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:57.972966 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3c84db25-5851-4d92-b061-31b3f0661430 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:58.051323 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-5d30a82d-625c-49f5-8b39-13f161fae049 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:58.060501 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-5d30a82d-625c-49f5-8b39-13f161fae049 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:58.062441 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-5d30a82d-625c-49f5-8b39-13f161fae049 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:58.063811 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-5d30a82d-625c-49f5-8b39-13f161fae049 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1406 microversion: 2.20 time: 0.227537 May 04 19:06:58.064988 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 51/109] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:06:57 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1406 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 04 19:06:58.124074 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-ade7da2d-49cd-44a1-99d4-e34c10ba416e tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:58.124074 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-ade7da2d-49cd-44a1-99d4-e34c10ba416e tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 4b5bd528-4bc3-4bf3-be31-89364096663f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:58.140022 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ade7da2d-49cd-44a1-99d4-e34c10ba416e tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:58.141397 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ade7da2d-49cd-44a1-99d4-e34c10ba416e tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:58.144166 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ade7da2d-49cd-44a1-99d4-e34c10ba416e tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:58.145537 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ade7da2d-49cd-44a1-99d4-e34c10ba416e tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:58.236002 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-3c84db25-5851-4d92-b061-31b3f0661430 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:58.243467 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-3c84db25-5851-4d92-b061-31b3f0661430 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1361 microversion: 2.1 time: 0.300946 May 04 19:06:58.244791 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 59/110] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:06:57 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1361 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:06:58.366922 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-799e72c4-3d43-46b1-9c58-4a96443556dc req-a71cf939-4f6b-431b-ba2b-0101ffcce641 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b5bd528-4bc3-4bf3-be31-89364096663f", "name": "network-vif-plugged", "status": "completed", "tag": "e803e0ad-7898-4a32-9dc5-0d5f670b9816"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:06:58.379615 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-799e72c4-3d43-46b1-9c58-4a96443556dc req-a71cf939-4f6b-431b-ba2b-0101ffcce641 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:58.380413 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-799e72c4-3d43-46b1-9c58-4a96443556dc req-a71cf939-4f6b-431b-ba2b-0101ffcce641 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:58.404839 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-799e72c4-3d43-46b1-9c58-4a96443556dc req-a71cf939-4f6b-431b-ba2b-0101ffcce641 service nova] Creating event network-vif-plugged:e803e0ad-7898-4a32-9dc5-0d5f670b9816 for instance 4b5bd528-4bc3-4bf3-be31-89364096663f on hv-cinder-83090 May 04 19:06:58.410933 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-799e72c4-3d43-46b1-9c58-4a96443556dc req-a71cf939-4f6b-431b-ba2b-0101ffcce641 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048966 May 04 19:06:58.412060 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 60/111] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 04 19:06:58.423187 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-ade7da2d-49cd-44a1-99d4-e34c10ba416e tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:58.431184 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-ade7da2d-49cd-44a1-99d4-e34c10ba416e tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f" status: 200 len: 1321 microversion: 2.1 time: 0.314487 May 04 19:06:58.431774 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 52/112] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:06:58 2022] GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f => generated 1321 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:06:59.082562 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-8fdba5d3-6ccc-4c20-822c-651b4425b657 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:59.083307 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-8fdba5d3-6ccc-4c20-822c-651b4425b657 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:59.091989 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8fdba5d3-6ccc-4c20-822c-651b4425b657 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:59.092505 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8fdba5d3-6ccc-4c20-822c-651b4425b657 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:59.093305 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8fdba5d3-6ccc-4c20-822c-651b4425b657 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:59.093753 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8fdba5d3-6ccc-4c20-822c-651b4425b657 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:59.262677 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-d2bdbd29-a382-4d71-bedc-a72117a13cda tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:59.264016 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-d2bdbd29-a382-4d71-bedc-a72117a13cda tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:59.275320 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d2bdbd29-a382-4d71-bedc-a72117a13cda tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:59.275711 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d2bdbd29-a382-4d71-bedc-a72117a13cda tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:59.280706 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d2bdbd29-a382-4d71-bedc-a72117a13cda tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:59.281220 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d2bdbd29-a382-4d71-bedc-a72117a13cda tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:59.367374 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-8fdba5d3-6ccc-4c20-822c-651b4425b657 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:59.387951 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-8fdba5d3-6ccc-4c20-822c-651b4425b657 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:59.391705 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-8fdba5d3-6ccc-4c20-822c-651b4425b657 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:59.396421 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-8fdba5d3-6ccc-4c20-822c-651b4425b657 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1406 microversion: 2.20 time: 0.318666 May 04 19:06:59.397485 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 61/113] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:06:59 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1406 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:06:59.449699 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-8339ec84-6c93-4465-b82c-42ee9b259b4c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:06:59.450355 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-8339ec84-6c93-4465-b82c-42ee9b259b4c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 4b5bd528-4bc3-4bf3-be31-89364096663f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:06:59.459438 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8339ec84-6c93-4465-b82c-42ee9b259b4c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:59.459961 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8339ec84-6c93-4465-b82c-42ee9b259b4c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:59.464084 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8339ec84-6c93-4465-b82c-42ee9b259b4c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:06:59.464822 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8339ec84-6c93-4465-b82c-42ee9b259b4c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:06:59.496595 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-d2bdbd29-a382-4d71-bedc-a72117a13cda tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:59.512256 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-d2bdbd29-a382-4d71-bedc-a72117a13cda tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1361 microversion: 2.1 time: 0.253126 May 04 19:06:59.524296 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 53/114] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:06:59 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1361 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:06:59.651950 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-8339ec84-6c93-4465-b82c-42ee9b259b4c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:06:59.666393 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-8339ec84-6c93-4465-b82c-42ee9b259b4c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f" status: 200 len: 1321 microversion: 2.1 time: 0.218491 May 04 19:06:59.673011 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 62/115] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:06:59 2022] GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f => generated 1321 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:00.415654 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-50f41d2c-8f40-4040-b584-6b1bfbc70000 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:00.416275 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-50f41d2c-8f40-4040-b584-6b1bfbc70000 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:00.422512 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-50f41d2c-8f40-4040-b584-6b1bfbc70000 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:00.423278 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-50f41d2c-8f40-4040-b584-6b1bfbc70000 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:00.424293 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-50f41d2c-8f40-4040-b584-6b1bfbc70000 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:00.424926 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-50f41d2c-8f40-4040-b584-6b1bfbc70000 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:00.532998 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-2d731aa2-c7ef-4894-9a6a-8bf5cd06338d tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:00.533895 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-2d731aa2-c7ef-4894-9a6a-8bf5cd06338d tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:00.549550 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2d731aa2-c7ef-4894-9a6a-8bf5cd06338d tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:00.550964 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2d731aa2-c7ef-4894-9a6a-8bf5cd06338d tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:00.553100 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2d731aa2-c7ef-4894-9a6a-8bf5cd06338d tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:00.554984 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2d731aa2-c7ef-4894-9a6a-8bf5cd06338d tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:00.637286 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-50f41d2c-8f40-4040-b584-6b1bfbc70000 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:00.646379 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-50f41d2c-8f40-4040-b584-6b1bfbc70000 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:00.650404 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-50f41d2c-8f40-4040-b584-6b1bfbc70000 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:00.651588 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-50f41d2c-8f40-4040-b584-6b1bfbc70000 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1599 microversion: 2.20 time: 0.239952 May 04 19:07:00.658529 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 54/116] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:07:00 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1599 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:07:00.673361 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-bdbf6ae8-3ec6-465a-aefb-17b640729c8c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:00.686352 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-bdbf6ae8-3ec6-465a-aefb-17b640729c8c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:00.694083 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-bdbf6ae8-3ec6-465a-aefb-17b640729c8c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:00.694716 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-bdbf6ae8-3ec6-465a-aefb-17b640729c8c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:00.695680 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-bdbf6ae8-3ec6-465a-aefb-17b640729c8c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:00.696387 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-bdbf6ae8-3ec6-465a-aefb-17b640729c8c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:00.854883 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-bdbf6ae8-3ec6-465a-aefb-17b640729c8c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.187620 May 04 19:07:00.861785 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 55/117] 10.222.0.69 () {60 vars in 1315 bytes} [Wed May 4 19:07:00 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5/os-interface => generated 285 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 04 19:07:00.867254 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-a23beb96-d32b-4a8d-b210-2d93dd0e9ab7 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:00.868347 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-a23beb96-d32b-4a8d-b210-2d93dd0e9ab7 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 4b5bd528-4bc3-4bf3-be31-89364096663f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:00.877445 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a23beb96-d32b-4a8d-b210-2d93dd0e9ab7 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:00.880974 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-2d731aa2-c7ef-4894-9a6a-8bf5cd06338d tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:00.881574 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a23beb96-d32b-4a8d-b210-2d93dd0e9ab7 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:00.883763 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a23beb96-d32b-4a8d-b210-2d93dd0e9ab7 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:00.885270 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a23beb96-d32b-4a8d-b210-2d93dd0e9ab7 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:00.889490 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-2d731aa2-c7ef-4894-9a6a-8bf5cd06338d tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1361 microversion: 2.1 time: 0.361568 May 04 19:07:00.890788 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 63/118] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:00 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1361 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:07:01.080660 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-a23beb96-d32b-4a8d-b210-2d93dd0e9ab7 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:01.089488 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-a23beb96-d32b-4a8d-b210-2d93dd0e9ab7 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f" status: 200 len: 1321 microversion: 2.1 time: 0.226143 May 04 19:07:01.090587 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 56/119] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:00 2022] GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f => generated 1321 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:01.908754 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-a977e380-35ac-43a2-99ac-c208a7aa6b2f tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:01.909879 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-a977e380-35ac-43a2-99ac-c208a7aa6b2f tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:01.920999 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a977e380-35ac-43a2-99ac-c208a7aa6b2f tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:01.930226 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a977e380-35ac-43a2-99ac-c208a7aa6b2f tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:01.933691 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a977e380-35ac-43a2-99ac-c208a7aa6b2f tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:01.934323 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a977e380-35ac-43a2-99ac-c208a7aa6b2f tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:02.111975 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-36fba557-59fc-482d-98c6-d745122c4e77 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:02.113272 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-36fba557-59fc-482d-98c6-d745122c4e77 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 4b5bd528-4bc3-4bf3-be31-89364096663f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:02.122948 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-36fba557-59fc-482d-98c6-d745122c4e77 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:02.124082 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-36fba557-59fc-482d-98c6-d745122c4e77 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:02.126025 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-36fba557-59fc-482d-98c6-d745122c4e77 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:02.128093 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-36fba557-59fc-482d-98c6-d745122c4e77 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:02.527875 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-36fba557-59fc-482d-98c6-d745122c4e77 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:02.537242 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-a977e380-35ac-43a2-99ac-c208a7aa6b2f tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:02.544058 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-36fba557-59fc-482d-98c6-d745122c4e77 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f" status: 200 len: 1514 microversion: 2.1 time: 0.437390 May 04 19:07:02.548907 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 57/120] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:02 2022] GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f => generated 1514 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:02.559149 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-a977e380-35ac-43a2-99ac-c208a7aa6b2f tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1361 microversion: 2.1 time: 0.650291 May 04 19:07:02.560113 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 64/121] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:01 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1361 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:02.565111 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-01ecbd33-349a-402a-90f2-5b36b1a4b382 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:07:02.568452 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-01ecbd33-349a-402a-90f2-5b36b1a4b382 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 4b5bd528-4bc3-4bf3-be31-89364096663f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:02.584482 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-01ecbd33-349a-402a-90f2-5b36b1a4b382 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:02.585086 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-01ecbd33-349a-402a-90f2-5b36b1a4b382 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:02.586075 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-01ecbd33-349a-402a-90f2-5b36b1a4b382 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:02.588773 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-01ecbd33-349a-402a-90f2-5b36b1a4b382 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:02.642032 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.objects.instance [None req-01ecbd33-349a-402a-90f2-5b36b1a4b382 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lazy-loading 'flavor' on Instance uuid 4b5bd528-4bc3-4bf3-be31-89364096663f {{(pid=117125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 04 19:07:02.865023 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-01ecbd33-349a-402a-90f2-5b36b1a4b382 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "POST /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f/action" status: 200 len: 32 microversion: 2.1 time: 0.303214 May 04 19:07:02.867281 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 58/122] 10.222.0.69 () {60 vars in 1277 bytes} [Wed May 4 19:07:02 2022] POST /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f/action => generated 32 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 04 19:07:02.878869 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-5358417e-0cb8-4af5-b76c-4ea89f7e8010 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:02.878869 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-5358417e-0cb8-4af5-b76c-4ea89f7e8010 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 4b5bd528-4bc3-4bf3-be31-89364096663f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:02.884815 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5358417e-0cb8-4af5-b76c-4ea89f7e8010 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:02.885545 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5358417e-0cb8-4af5-b76c-4ea89f7e8010 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:02.887824 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5358417e-0cb8-4af5-b76c-4ea89f7e8010 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:02.889151 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5358417e-0cb8-4af5-b76c-4ea89f7e8010 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:03.047314 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-8cfad1da-8c82-486b-a931-6919df6c027a req-eda30ed1-1f7a-4a9a-8307-3fe7ae6cb283 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f929e9e-51bf-477a-877b-6c162202c7f5", "tag": "c2916343-9825-41ef-93c5-4b2dbc6d65a9"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:07:03.058189 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-8cfad1da-8c82-486b-a931-6919df6c027a req-eda30ed1-1f7a-4a9a-8307-3fe7ae6cb283 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:03.059003 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-8cfad1da-8c82-486b-a931-6919df6c027a req-eda30ed1-1f7a-4a9a-8307-3fe7ae6cb283 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:03.073791 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-8cfad1da-8c82-486b-a931-6919df6c027a req-eda30ed1-1f7a-4a9a-8307-3fe7ae6cb283 service nova] Creating event network-changed:c2916343-9825-41ef-93c5-4b2dbc6d65a9 for instance 8f929e9e-51bf-477a-877b-6c162202c7f5 on hv-cinder-83090 May 04 19:07:03.080640 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-8cfad1da-8c82-486b-a931-6919df6c027a req-eda30ed1-1f7a-4a9a-8307-3fe7ae6cb283 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037482 May 04 19:07:03.081979 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 59/123] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 04 19:07:03.095516 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-5358417e-0cb8-4af5-b76c-4ea89f7e8010 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:03.106895 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-5358417e-0cb8-4af5-b76c-4ea89f7e8010 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f" status: 200 len: 1520 microversion: 2.1 time: 0.231418 May 04 19:07:03.107660 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 65/124] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:02 2022] GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f => generated 1520 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:03.576646 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-63402c82-2227-4bf4-8026-336ebaa5765d tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:03.578983 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-63402c82-2227-4bf4-8026-336ebaa5765d tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:03.585917 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-63402c82-2227-4bf4-8026-336ebaa5765d tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:03.586376 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-63402c82-2227-4bf4-8026-336ebaa5765d tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:03.587262 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-63402c82-2227-4bf4-8026-336ebaa5765d tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:03.587870 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-63402c82-2227-4bf4-8026-336ebaa5765d tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:03.749301 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-63402c82-2227-4bf4-8026-336ebaa5765d tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:03.761431 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-63402c82-2227-4bf4-8026-336ebaa5765d tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1361 microversion: 2.1 time: 0.188762 May 04 19:07:03.762608 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 60/125] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:03 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1361 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:04.124694 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-c9b048fa-45e4-4d09-bce3-ba6fc8a81e94 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:04.125318 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-c9b048fa-45e4-4d09-bce3-ba6fc8a81e94 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 4b5bd528-4bc3-4bf3-be31-89364096663f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:04.132221 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c9b048fa-45e4-4d09-bce3-ba6fc8a81e94 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:04.132707 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c9b048fa-45e4-4d09-bce3-ba6fc8a81e94 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:04.133453 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c9b048fa-45e4-4d09-bce3-ba6fc8a81e94 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:04.134176 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c9b048fa-45e4-4d09-bce3-ba6fc8a81e94 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:04.326834 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-c9b048fa-45e4-4d09-bce3-ba6fc8a81e94 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:04.335578 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-c9b048fa-45e4-4d09-bce3-ba6fc8a81e94 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f" status: 200 len: 1520 microversion: 2.1 time: 0.215052 May 04 19:07:04.336812 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 66/126] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:04 2022] GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f => generated 1520 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:04.779250 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-be044f8f-eea9-4f62-b341-6c10b5c708ab tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:04.779860 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-be044f8f-eea9-4f62-b341-6c10b5c708ab tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:04.785931 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-be044f8f-eea9-4f62-b341-6c10b5c708ab tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:04.786346 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-be044f8f-eea9-4f62-b341-6c10b5c708ab tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:04.787167 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-be044f8f-eea9-4f62-b341-6c10b5c708ab tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:04.787602 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-be044f8f-eea9-4f62-b341-6c10b5c708ab tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:04.931815 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-be044f8f-eea9-4f62-b341-6c10b5c708ab tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:04.940062 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-be044f8f-eea9-4f62-b341-6c10b5c708ab tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1361 microversion: 2.1 time: 0.164846 May 04 19:07:04.940643 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 61/127] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:04 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1361 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:05.354624 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-fd7bfa68-a0e3-480d-a361-50c5d8d17323 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:05.355238 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-fd7bfa68-a0e3-480d-a361-50c5d8d17323 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 4b5bd528-4bc3-4bf3-be31-89364096663f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:05.362931 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fd7bfa68-a0e3-480d-a361-50c5d8d17323 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:05.363388 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fd7bfa68-a0e3-480d-a361-50c5d8d17323 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:05.364170 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fd7bfa68-a0e3-480d-a361-50c5d8d17323 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:05.364610 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fd7bfa68-a0e3-480d-a361-50c5d8d17323 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:05.569430 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-fd7bfa68-a0e3-480d-a361-50c5d8d17323 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:05.589988 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-fd7bfa68-a0e3-480d-a361-50c5d8d17323 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f" status: 200 len: 1520 microversion: 2.1 time: 0.239728 May 04 19:07:05.591322 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 67/128] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:05 2022] GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f => generated 1520 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:05.964289 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-31570310-fdb6-4394-85a6-6477576b981d tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:05.965457 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-31570310-fdb6-4394-85a6-6477576b981d tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:05.977219 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-31570310-fdb6-4394-85a6-6477576b981d tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:05.977663 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-31570310-fdb6-4394-85a6-6477576b981d tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:05.986506 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-31570310-fdb6-4394-85a6-6477576b981d tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:05.986506 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-31570310-fdb6-4394-85a6-6477576b981d tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:06.125906 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-31570310-fdb6-4394-85a6-6477576b981d tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:06.133888 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-31570310-fdb6-4394-85a6-6477576b981d tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1361 microversion: 2.1 time: 0.180008 May 04 19:07:06.145026 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 62/129] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:05 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1361 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:06.607582 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-913cdd37-f0c4-4975-a7cf-755b9b5d6910 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:06.608187 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-913cdd37-f0c4-4975-a7cf-755b9b5d6910 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 4b5bd528-4bc3-4bf3-be31-89364096663f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:06.614340 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-913cdd37-f0c4-4975-a7cf-755b9b5d6910 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:06.614798 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-913cdd37-f0c4-4975-a7cf-755b9b5d6910 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:06.615564 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-913cdd37-f0c4-4975-a7cf-755b9b5d6910 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:06.616215 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-913cdd37-f0c4-4975-a7cf-755b9b5d6910 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:06.772069 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-913cdd37-f0c4-4975-a7cf-755b9b5d6910 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:06.781355 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-913cdd37-f0c4-4975-a7cf-755b9b5d6910 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f" status: 200 len: 1520 microversion: 2.1 time: 0.177825 May 04 19:07:06.782457 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 68/130] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:06 2022] GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:07.155479 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-2221952a-c6a0-4e00-b4ff-96a165b62b45 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:07.156127 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-2221952a-c6a0-4e00-b4ff-96a165b62b45 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:07.162522 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2221952a-c6a0-4e00-b4ff-96a165b62b45 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:07.162991 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2221952a-c6a0-4e00-b4ff-96a165b62b45 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:07.163751 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2221952a-c6a0-4e00-b4ff-96a165b62b45 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:07.164195 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2221952a-c6a0-4e00-b4ff-96a165b62b45 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:07.183100 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-39396720-c336-4857-bd0c-18c27bebd241 req-86c52cf0-3405-43b1-bf24-af53f2dc4ec9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d", "name": "network-vif-plugged", "status": "completed", "tag": "f2a67d60-fe59-49da-83ac-a36d263ffa54"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:07:07.199827 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-39396720-c336-4857-bd0c-18c27bebd241 req-86c52cf0-3405-43b1-bf24-af53f2dc4ec9 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:07.200826 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-39396720-c336-4857-bd0c-18c27bebd241 req-86c52cf0-3405-43b1-bf24-af53f2dc4ec9 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:07.215620 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-39396720-c336-4857-bd0c-18c27bebd241 req-86c52cf0-3405-43b1-bf24-af53f2dc4ec9 service nova] Creating event network-vif-plugged:f2a67d60-fe59-49da-83ac-a36d263ffa54 for instance f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d on hv-cinder-83090 May 04 19:07:07.221410 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-39396720-c336-4857-bd0c-18c27bebd241 req-86c52cf0-3405-43b1-bf24-af53f2dc4ec9 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043809 May 04 19:07:07.222321 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 69/131] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:07:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 04 19:07:07.314816 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-2221952a-c6a0-4e00-b4ff-96a165b62b45 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:07.322425 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-2221952a-c6a0-4e00-b4ff-96a165b62b45 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1361 microversion: 2.1 time: 0.171219 May 04 19:07:07.323049 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 63/132] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:07 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1361 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:07.799847 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-2e03afad-3b04-4870-8be5-0c19e22e55c3 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:07.800656 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-2e03afad-3b04-4870-8be5-0c19e22e55c3 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 4b5bd528-4bc3-4bf3-be31-89364096663f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:07.807079 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2e03afad-3b04-4870-8be5-0c19e22e55c3 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:07.807885 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2e03afad-3b04-4870-8be5-0c19e22e55c3 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:07.809116 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2e03afad-3b04-4870-8be5-0c19e22e55c3 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:07.809696 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2e03afad-3b04-4870-8be5-0c19e22e55c3 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:07.955529 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-2e03afad-3b04-4870-8be5-0c19e22e55c3 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:07.963770 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-2e03afad-3b04-4870-8be5-0c19e22e55c3 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f" status: 200 len: 1520 microversion: 2.1 time: 0.169454 May 04 19:07:07.964585 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 70/133] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:07 2022] GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:08.340673 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-829e2683-50c2-46eb-813c-ae2ee990c1d6 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:08.341276 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-829e2683-50c2-46eb-813c-ae2ee990c1d6 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:08.346998 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-829e2683-50c2-46eb-813c-ae2ee990c1d6 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:08.347437 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-829e2683-50c2-46eb-813c-ae2ee990c1d6 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:08.348185 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-829e2683-50c2-46eb-813c-ae2ee990c1d6 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:08.348640 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-829e2683-50c2-46eb-813c-ae2ee990c1d6 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:08.478636 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-829e2683-50c2-46eb-813c-ae2ee990c1d6 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:08.490397 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-829e2683-50c2-46eb-813c-ae2ee990c1d6 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1361 microversion: 2.1 time: 0.154209 May 04 19:07:08.490970 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 64/134] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:08 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:08.980774 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-5f68bf66-da8a-4295-b291-8b53f0a28af7 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:08.981412 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-5f68bf66-da8a-4295-b291-8b53f0a28af7 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 4b5bd528-4bc3-4bf3-be31-89364096663f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:08.987759 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5f68bf66-da8a-4295-b291-8b53f0a28af7 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:08.988212 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5f68bf66-da8a-4295-b291-8b53f0a28af7 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:08.989016 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5f68bf66-da8a-4295-b291-8b53f0a28af7 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:08.989454 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5f68bf66-da8a-4295-b291-8b53f0a28af7 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:09.126607 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-5f68bf66-da8a-4295-b291-8b53f0a28af7 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:09.134904 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-5f68bf66-da8a-4295-b291-8b53f0a28af7 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f" status: 200 len: 1520 microversion: 2.1 time: 0.158630 May 04 19:07:09.136045 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 71/135] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:08 2022] GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:09.237229 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-d32f0b73-7567-4488-ad83-dcb575e2db2f tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:09.238006 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-d32f0b73-7567-4488-ad83-dcb575e2db2f tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] [instance: 4c34ec07-a8d6-42d2-b843-d319612cfe2d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:09.244653 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d32f0b73-7567-4488-ad83-dcb575e2db2f tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:09.245090 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d32f0b73-7567-4488-ad83-dcb575e2db2f tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:09.245887 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d32f0b73-7567-4488-ad83-dcb575e2db2f tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:09.246310 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d32f0b73-7567-4488-ad83-dcb575e2db2f tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:09.277374 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-d32f0b73-7567-4488-ad83-dcb575e2db2f tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] [instance: 4c34ec07-a8d6-42d2-b843-d319612cfe2d] Going to try to terminate instance {{(pid=117125) delete /opt/stack/nova/nova/compute/api.py:2664}} May 04 19:07:09.380050 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-d32f0b73-7567-4488-ad83-dcb575e2db2f tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] 10.222.0.69 "DELETE /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d" status: 204 len: 0 microversion: 2.1 time: 0.147197 May 04 19:07:09.382064 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 65/136] 10.222.0.69 () {58 vars in 1238 bytes} [Wed May 4 19:07:09 2022] DELETE /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 04 19:07:09.390877 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-e3e01847-e5bc-4a47-933d-e30828ff32e0 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:09.392068 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-e3e01847-e5bc-4a47-933d-e30828ff32e0 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] [instance: 4c34ec07-a8d6-42d2-b843-d319612cfe2d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:09.399078 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e3e01847-e5bc-4a47-933d-e30828ff32e0 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:09.400114 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e3e01847-e5bc-4a47-933d-e30828ff32e0 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:09.401307 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e3e01847-e5bc-4a47-933d-e30828ff32e0 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:09.401958 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e3e01847-e5bc-4a47-933d-e30828ff32e0 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:09.509570 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-29c8091c-2c70-402f-b37d-043f1d54972c tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:09.510660 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-29c8091c-2c70-402f-b37d-043f1d54972c tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:09.517169 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-29c8091c-2c70-402f-b37d-043f1d54972c tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:09.517943 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-29c8091c-2c70-402f-b37d-043f1d54972c tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:09.518818 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-29c8091c-2c70-402f-b37d-043f1d54972c tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:09.519298 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-29c8091c-2c70-402f-b37d-043f1d54972c tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:09.559803 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-e3e01847-e5bc-4a47-933d-e30828ff32e0 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719edb67e8ae41b885581ae3645dd85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6009c7f43b406e850c819b5b50311c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:09.570404 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-e3e01847-e5bc-4a47-933d-e30828ff32e0 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] 10.222.0.69 "GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d" status: 200 len: 1553 microversion: 2.1 time: 0.183793 May 04 19:07:09.571201 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 72/137] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:09 2022] GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d => generated 1553 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:09.680923 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-29c8091c-2c70-402f-b37d-043f1d54972c tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:09.688650 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-29c8091c-2c70-402f-b37d-043f1d54972c tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1361 microversion: 2.1 time: 0.184251 May 04 19:07:09.689354 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 66/138] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:09 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1361 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:07:10.153924 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-d3785160-6d67-4983-8968-f6b4d9aa0181 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:10.154559 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-d3785160-6d67-4983-8968-f6b4d9aa0181 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 4b5bd528-4bc3-4bf3-be31-89364096663f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:10.165420 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d3785160-6d67-4983-8968-f6b4d9aa0181 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:10.165906 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d3785160-6d67-4983-8968-f6b4d9aa0181 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:10.166759 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d3785160-6d67-4983-8968-f6b4d9aa0181 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:10.167388 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d3785160-6d67-4983-8968-f6b4d9aa0181 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:10.335246 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-d3785160-6d67-4983-8968-f6b4d9aa0181 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:10.345075 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-d3785160-6d67-4983-8968-f6b4d9aa0181 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f" status: 200 len: 1520 microversion: 2.1 time: 0.196524 May 04 19:07:10.346092 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 73/139] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:10 2022] GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f => generated 1520 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:07:10.588544 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-7ee85acc-9d6a-4700-a943-8a36dbaacec0 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:10.589811 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-7ee85acc-9d6a-4700-a943-8a36dbaacec0 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] [instance: 4c34ec07-a8d6-42d2-b843-d319612cfe2d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:10.596036 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7ee85acc-9d6a-4700-a943-8a36dbaacec0 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:10.596489 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7ee85acc-9d6a-4700-a943-8a36dbaacec0 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:10.597260 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7ee85acc-9d6a-4700-a943-8a36dbaacec0 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:10.597723 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7ee85acc-9d6a-4700-a943-8a36dbaacec0 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:10.707773 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-a5da2870-79c6-48c0-b4d7-cbb1c067d142 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:10.708445 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-a5da2870-79c6-48c0-b4d7-cbb1c067d142 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:10.716621 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a5da2870-79c6-48c0-b4d7-cbb1c067d142 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:10.717531 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a5da2870-79c6-48c0-b4d7-cbb1c067d142 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:10.718631 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a5da2870-79c6-48c0-b4d7-cbb1c067d142 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:10.719330 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a5da2870-79c6-48c0-b4d7-cbb1c067d142 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:10.752730 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-7ee85acc-9d6a-4700-a943-8a36dbaacec0 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719edb67e8ae41b885581ae3645dd85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6009c7f43b406e850c819b5b50311c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:10.761181 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-7ee85acc-9d6a-4700-a943-8a36dbaacec0 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] 10.222.0.69 "GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d" status: 200 len: 1553 microversion: 2.1 time: 0.176433 May 04 19:07:10.761796 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 67/140] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:10 2022] GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d => generated 1553 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:10.901271 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-a5da2870-79c6-48c0-b4d7-cbb1c067d142 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:10.908529 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-a5da2870-79c6-48c0-b4d7-cbb1c067d142 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1361 microversion: 2.1 time: 0.205886 May 04 19:07:10.909101 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 74/141] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:10 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1361 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:07:11.362806 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-6e25073f-1db1-4413-98d5-d82382e10312 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:11.363405 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-6e25073f-1db1-4413-98d5-d82382e10312 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 4b5bd528-4bc3-4bf3-be31-89364096663f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:11.370412 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6e25073f-1db1-4413-98d5-d82382e10312 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:11.374790 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6e25073f-1db1-4413-98d5-d82382e10312 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:11.375690 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6e25073f-1db1-4413-98d5-d82382e10312 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:11.376135 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6e25073f-1db1-4413-98d5-d82382e10312 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:11.557549 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-6e25073f-1db1-4413-98d5-d82382e10312 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:11.571830 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-6e25073f-1db1-4413-98d5-d82382e10312 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f" status: 200 len: 1520 microversion: 2.1 time: 0.211590 May 04 19:07:11.572997 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 68/142] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:11 2022] GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f => generated 1520 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:11.779189 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-a559e1de-3f7d-4b61-a8d6-bf425131f084 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:11.779798 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-a559e1de-3f7d-4b61-a8d6-bf425131f084 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] [instance: 4c34ec07-a8d6-42d2-b843-d319612cfe2d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:11.786339 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a559e1de-3f7d-4b61-a8d6-bf425131f084 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:11.786776 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a559e1de-3f7d-4b61-a8d6-bf425131f084 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:11.787540 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a559e1de-3f7d-4b61-a8d6-bf425131f084 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:11.787965 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a559e1de-3f7d-4b61-a8d6-bf425131f084 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:11.927917 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-bc244276-1a16-4ba3-a1c1-f6c2aa62d417 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:11.929184 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-bc244276-1a16-4ba3-a1c1-f6c2aa62d417 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:11.936149 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-bc244276-1a16-4ba3-a1c1-f6c2aa62d417 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:11.936757 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-bc244276-1a16-4ba3-a1c1-f6c2aa62d417 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:11.938002 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-bc244276-1a16-4ba3-a1c1-f6c2aa62d417 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:11.938513 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-bc244276-1a16-4ba3-a1c1-f6c2aa62d417 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:11.967545 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-a559e1de-3f7d-4b61-a8d6-bf425131f084 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719edb67e8ae41b885581ae3645dd85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6009c7f43b406e850c819b5b50311c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:11.976620 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-a559e1de-3f7d-4b61-a8d6-bf425131f084 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] 10.222.0.69 "GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d" status: 200 len: 1553 microversion: 2.1 time: 0.201887 May 04 19:07:11.977612 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 75/143] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:11 2022] GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d => generated 1553 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:12.125264 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-bc244276-1a16-4ba3-a1c1-f6c2aa62d417 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:12.135398 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-bc244276-1a16-4ba3-a1c1-f6c2aa62d417 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1547 microversion: 2.1 time: 0.213223 May 04 19:07:12.136152 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 69/144] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:11 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1547 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:12.153027 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-09263cf2-494c-4dcc-99ac-1cef80c8f65e tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:12.153608 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-09263cf2-494c-4dcc-99ac-1cef80c8f65e tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:12.159776 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-09263cf2-494c-4dcc-99ac-1cef80c8f65e tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:12.160337 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-09263cf2-494c-4dcc-99ac-1cef80c8f65e tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:12.161155 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-09263cf2-494c-4dcc-99ac-1cef80c8f65e tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:12.161691 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-09263cf2-494c-4dcc-99ac-1cef80c8f65e tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:12.242792 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-09263cf2-494c-4dcc-99ac-1cef80c8f65e tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093580 May 04 19:07:12.244067 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 76/145] 10.222.0.69 () {58 vars in 1274 bytes} [Wed May 4 19:07:12 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:07:12.589646 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-331a6e2f-455c-49bb-aa43-994269423430 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:12.590509 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-331a6e2f-455c-49bb-aa43-994269423430 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 4b5bd528-4bc3-4bf3-be31-89364096663f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:12.596743 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-331a6e2f-455c-49bb-aa43-994269423430 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:12.597526 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-331a6e2f-455c-49bb-aa43-994269423430 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:12.598362 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-331a6e2f-455c-49bb-aa43-994269423430 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:12.598866 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-331a6e2f-455c-49bb-aa43-994269423430 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:12.772825 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-331a6e2f-455c-49bb-aa43-994269423430 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:12.781561 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-331a6e2f-455c-49bb-aa43-994269423430 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f" status: 200 len: 1520 microversion: 2.1 time: 0.195690 May 04 19:07:12.782765 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 70/146] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:12 2022] GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f => generated 1520 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:12.994535 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-460a4747-14df-4ab0-8199-67ad090e4335 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:12.996145 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-460a4747-14df-4ab0-8199-67ad090e4335 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] [instance: 4c34ec07-a8d6-42d2-b843-d319612cfe2d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:13.003206 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-460a4747-14df-4ab0-8199-67ad090e4335 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:13.003673 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-460a4747-14df-4ab0-8199-67ad090e4335 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:13.004454 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-460a4747-14df-4ab0-8199-67ad090e4335 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:13.004892 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-460a4747-14df-4ab0-8199-67ad090e4335 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:13.314728 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-460a4747-14df-4ab0-8199-67ad090e4335 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719edb67e8ae41b885581ae3645dd85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6009c7f43b406e850c819b5b50311c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:13.323836 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-460a4747-14df-4ab0-8199-67ad090e4335 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] 10.222.0.69 "GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d" status: 200 len: 1553 microversion: 2.1 time: 0.333402 May 04 19:07:13.324597 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 77/147] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:12 2022] GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d => generated 1553 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:13.600502 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-45805e89-711d-47d4-a14b-153e812314a6 req-6d77d899-4b44-4d0b-a8c7-1c79f2b65cb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d", "tag": "f2a67d60-fe59-49da-83ac-a36d263ffa54"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:07:13.607703 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-45805e89-711d-47d4-a14b-153e812314a6 req-6d77d899-4b44-4d0b-a8c7-1c79f2b65cb0 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:13.608232 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-45805e89-711d-47d4-a14b-153e812314a6 req-6d77d899-4b44-4d0b-a8c7-1c79f2b65cb0 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:13.619898 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-45805e89-711d-47d4-a14b-153e812314a6 req-6d77d899-4b44-4d0b-a8c7-1c79f2b65cb0 service nova] Creating event network-changed:f2a67d60-fe59-49da-83ac-a36d263ffa54 for instance f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d on hv-cinder-83090 May 04 19:07:13.625135 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-45805e89-711d-47d4-a14b-153e812314a6 req-6d77d899-4b44-4d0b-a8c7-1c79f2b65cb0 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029326 May 04 19:07:13.626014 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 71/148] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:07:13.799805 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-3dc6abfe-0562-47fd-b912-37d75fa1a268 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:13.800677 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-3dc6abfe-0562-47fd-b912-37d75fa1a268 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 4b5bd528-4bc3-4bf3-be31-89364096663f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:13.807150 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3dc6abfe-0562-47fd-b912-37d75fa1a268 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:13.807601 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3dc6abfe-0562-47fd-b912-37d75fa1a268 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:13.808485 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3dc6abfe-0562-47fd-b912-37d75fa1a268 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:13.808925 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3dc6abfe-0562-47fd-b912-37d75fa1a268 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:13.947626 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-3dc6abfe-0562-47fd-b912-37d75fa1a268 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:13.955369 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-3dc6abfe-0562-47fd-b912-37d75fa1a268 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f" status: 200 len: 1520 microversion: 2.1 time: 0.159409 May 04 19:07:13.955944 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 78/149] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:13 2022] GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:14.342021 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-5ce428bb-e7e3-406a-969f-0c7acdd95b59 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:14.342971 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-5ce428bb-e7e3-406a-969f-0c7acdd95b59 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] [instance: 4c34ec07-a8d6-42d2-b843-d319612cfe2d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:14.349663 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5ce428bb-e7e3-406a-969f-0c7acdd95b59 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:14.350107 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5ce428bb-e7e3-406a-969f-0c7acdd95b59 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:14.350864 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5ce428bb-e7e3-406a-969f-0c7acdd95b59 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:14.351293 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5ce428bb-e7e3-406a-969f-0c7acdd95b59 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:14.510846 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-5ce428bb-e7e3-406a-969f-0c7acdd95b59 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719edb67e8ae41b885581ae3645dd85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6009c7f43b406e850c819b5b50311c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:14.518972 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-5ce428bb-e7e3-406a-969f-0c7acdd95b59 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] 10.222.0.69 "GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d" status: 200 len: 1553 microversion: 2.1 time: 0.182588 May 04 19:07:14.519739 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 72/150] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:14 2022] GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d => generated 1553 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:14.972467 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-af75b814-9610-4581-8d6b-3f6fde9f879d tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:14.973082 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-af75b814-9610-4581-8d6b-3f6fde9f879d tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 4b5bd528-4bc3-4bf3-be31-89364096663f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:14.979915 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-af75b814-9610-4581-8d6b-3f6fde9f879d tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:14.980346 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-af75b814-9610-4581-8d6b-3f6fde9f879d tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:14.981105 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-af75b814-9610-4581-8d6b-3f6fde9f879d tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:14.981588 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-af75b814-9610-4581-8d6b-3f6fde9f879d tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:15.109749 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-af75b814-9610-4581-8d6b-3f6fde9f879d tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:15.116988 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-af75b814-9610-4581-8d6b-3f6fde9f879d tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f" status: 200 len: 1520 microversion: 2.1 time: 0.148574 May 04 19:07:15.117584 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 79/151] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:14 2022] GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:07:15.536203 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-57fdc75d-ac49-4530-9677-7d098d6e982d tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:15.536816 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-57fdc75d-ac49-4530-9677-7d098d6e982d tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] [instance: 4c34ec07-a8d6-42d2-b843-d319612cfe2d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:15.543190 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-57fdc75d-ac49-4530-9677-7d098d6e982d tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:15.543706 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-57fdc75d-ac49-4530-9677-7d098d6e982d tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:15.544554 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-57fdc75d-ac49-4530-9677-7d098d6e982d tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:15.545054 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-57fdc75d-ac49-4530-9677-7d098d6e982d tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:15.675827 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-57fdc75d-ac49-4530-9677-7d098d6e982d tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719edb67e8ae41b885581ae3645dd85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6009c7f43b406e850c819b5b50311c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:15.684570 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-57fdc75d-ac49-4530-9677-7d098d6e982d tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] 10.222.0.69 "GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d" status: 200 len: 1553 microversion: 2.1 time: 0.152267 May 04 19:07:15.685153 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 73/152] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:15 2022] GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:16.134935 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-05821b09-ad1f-4558-abc5-92fa79be4785 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:16.135696 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-05821b09-ad1f-4558-abc5-92fa79be4785 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 4b5bd528-4bc3-4bf3-be31-89364096663f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:16.142577 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-05821b09-ad1f-4558-abc5-92fa79be4785 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:16.143210 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-05821b09-ad1f-4558-abc5-92fa79be4785 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:16.144151 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-05821b09-ad1f-4558-abc5-92fa79be4785 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:16.145238 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-05821b09-ad1f-4558-abc5-92fa79be4785 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:16.368851 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-05821b09-ad1f-4558-abc5-92fa79be4785 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:16.381971 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-05821b09-ad1f-4558-abc5-92fa79be4785 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f" status: 200 len: 1520 microversion: 2.1 time: 0.250328 May 04 19:07:16.393064 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 80/153] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:16 2022] GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f => generated 1520 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:16.447423 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-83d1fa4c-1d49-458b-926c-02431fda4cae req-d2001156-e843-4884-a2d2-1aa93e136232 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c34ec07-a8d6-42d2-b843-d319612cfe2d", "name": "network-vif-unplugged", "status": "completed", "tag": "84ae57cd-445d-48f4-a111-8b738c387bc3"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:07:16.459348 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-83d1fa4c-1d49-458b-926c-02431fda4cae req-d2001156-e843-4884-a2d2-1aa93e136232 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:16.460008 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-83d1fa4c-1d49-458b-926c-02431fda4cae req-d2001156-e843-4884-a2d2-1aa93e136232 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:16.482212 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-83d1fa4c-1d49-458b-926c-02431fda4cae req-d2001156-e843-4884-a2d2-1aa93e136232 service nova] Creating event network-vif-unplugged:84ae57cd-445d-48f4-a111-8b738c387bc3 for instance 4c34ec07-a8d6-42d2-b843-d319612cfe2d on hv-cinder-83090 May 04 19:07:16.489649 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-83d1fa4c-1d49-458b-926c-02431fda4cae req-d2001156-e843-4884-a2d2-1aa93e136232 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061799 May 04 19:07:16.490971 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 74/154] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:07:16.702447 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-840ffa84-9955-461f-b7ea-728ab62af362 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:16.703366 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-840ffa84-9955-461f-b7ea-728ab62af362 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] [instance: 4c34ec07-a8d6-42d2-b843-d319612cfe2d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:16.710137 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-840ffa84-9955-461f-b7ea-728ab62af362 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:16.710823 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-840ffa84-9955-461f-b7ea-728ab62af362 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:16.711829 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-840ffa84-9955-461f-b7ea-728ab62af362 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:16.712499 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-840ffa84-9955-461f-b7ea-728ab62af362 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:16.763741 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-b783becb-c0fc-4b38-81fa-108947789f43 req-deea39e4-fc07-4aab-9358-2af9313a9919 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c34ec07-a8d6-42d2-b843-d319612cfe2d", "name": "network-vif-deleted", "tag": "84ae57cd-445d-48f4-a111-8b738c387bc3"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:07:16.779103 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-b783becb-c0fc-4b38-81fa-108947789f43 req-deea39e4-fc07-4aab-9358-2af9313a9919 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:16.780213 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-b783becb-c0fc-4b38-81fa-108947789f43 req-deea39e4-fc07-4aab-9358-2af9313a9919 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:16.791307 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-840ffa84-9955-461f-b7ea-728ab62af362 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719edb67e8ae41b885581ae3645dd85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6009c7f43b406e850c819b5b50311c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:16.797780 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-b783becb-c0fc-4b38-81fa-108947789f43 req-deea39e4-fc07-4aab-9358-2af9313a9919 service nova] Creating event network-vif-deleted:84ae57cd-445d-48f4-a111-8b738c387bc3 for instance 4c34ec07-a8d6-42d2-b843-d319612cfe2d on hv-cinder-83090 May 04 19:07:16.801715 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-840ffa84-9955-461f-b7ea-728ab62af362 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] 10.222.0.69 "GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d" status: 200 len: 1511 microversion: 2.1 time: 0.103909 May 04 19:07:16.805244 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 81/155] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:16 2022] GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d => generated 1511 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:16.815455 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-b783becb-c0fc-4b38-81fa-108947789f43 req-deea39e4-fc07-4aab-9358-2af9313a9919 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047647 May 04 19:07:16.815803 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 75/156] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:07:17.401062 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-f6b489e5-bf1f-415f-9198-52cbd13f3dc3 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:17.401932 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-f6b489e5-bf1f-415f-9198-52cbd13f3dc3 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 4b5bd528-4bc3-4bf3-be31-89364096663f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:17.407995 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f6b489e5-bf1f-415f-9198-52cbd13f3dc3 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:17.408448 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f6b489e5-bf1f-415f-9198-52cbd13f3dc3 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:17.409211 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f6b489e5-bf1f-415f-9198-52cbd13f3dc3 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:17.409674 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f6b489e5-bf1f-415f-9198-52cbd13f3dc3 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:17.542094 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-f6b489e5-bf1f-415f-9198-52cbd13f3dc3 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:17.553849 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-f6b489e5-bf1f-415f-9198-52cbd13f3dc3 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f" status: 200 len: 1520 microversion: 2.1 time: 0.157377 May 04 19:07:17.554448 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 76/157] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:17 2022] GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:07:17.823269 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-cd96ae26-570a-4958-97d8-a73df34112b2 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:17.823874 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-cd96ae26-570a-4958-97d8-a73df34112b2 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] [instance: 4c34ec07-a8d6-42d2-b843-d319612cfe2d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:17.830098 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-cd96ae26-570a-4958-97d8-a73df34112b2 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:17.830538 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-cd96ae26-570a-4958-97d8-a73df34112b2 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:17.831293 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-cd96ae26-570a-4958-97d8-a73df34112b2 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:17.831715 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-cd96ae26-570a-4958-97d8-a73df34112b2 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:17.895889 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-cd96ae26-570a-4958-97d8-a73df34112b2 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719edb67e8ae41b885581ae3645dd85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6009c7f43b406e850c819b5b50311c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:17.908163 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-cd96ae26-570a-4958-97d8-a73df34112b2 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] 10.222.0.69 "GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d" status: 200 len: 1346 microversion: 2.1 time: 0.089011 May 04 19:07:17.909024 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 82/158] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:17 2022] GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d => generated 1346 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:18.570575 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-1e4c2e93-f357-46e2-b05c-a1ca4443526a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:18.571089 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-1e4c2e93-f357-46e2-b05c-a1ca4443526a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 4b5bd528-4bc3-4bf3-be31-89364096663f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:18.577153 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1e4c2e93-f357-46e2-b05c-a1ca4443526a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:18.577680 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1e4c2e93-f357-46e2-b05c-a1ca4443526a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:18.578508 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1e4c2e93-f357-46e2-b05c-a1ca4443526a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:18.579007 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1e4c2e93-f357-46e2-b05c-a1ca4443526a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:18.712542 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-1e4c2e93-f357-46e2-b05c-a1ca4443526a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:18.720430 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-1e4c2e93-f357-46e2-b05c-a1ca4443526a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f" status: 200 len: 1520 microversion: 2.1 time: 0.153726 May 04 19:07:18.721006 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 77/159] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:18 2022] GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:18.929245 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-063becda-66d7-4441-b037-67961b9e7615 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:18.929961 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-063becda-66d7-4441-b037-67961b9e7615 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] [instance: 4c34ec07-a8d6-42d2-b843-d319612cfe2d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:18.936349 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-063becda-66d7-4441-b037-67961b9e7615 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:18.936869 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-063becda-66d7-4441-b037-67961b9e7615 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:18.937742 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-063becda-66d7-4441-b037-67961b9e7615 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:18.938177 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-063becda-66d7-4441-b037-67961b9e7615 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:18.999234 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-063becda-66d7-4441-b037-67961b9e7615 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719edb67e8ae41b885581ae3645dd85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6009c7f43b406e850c819b5b50311c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:19.007961 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-063becda-66d7-4441-b037-67961b9e7615 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] 10.222.0.69 "GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d" status: 200 len: 1346 microversion: 2.1 time: 0.082422 May 04 19:07:19.008577 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 83/160] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:18 2022] GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d => generated 1346 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:19.742402 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-5f0442b9-93a8-464b-a843-39639ca68302 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:19.744030 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-5f0442b9-93a8-464b-a843-39639ca68302 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 4b5bd528-4bc3-4bf3-be31-89364096663f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:19.752662 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5f0442b9-93a8-464b-a843-39639ca68302 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:19.753257 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5f0442b9-93a8-464b-a843-39639ca68302 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:19.754209 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5f0442b9-93a8-464b-a843-39639ca68302 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:19.754666 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5f0442b9-93a8-464b-a843-39639ca68302 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:19.965809 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-5f0442b9-93a8-464b-a843-39639ca68302 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:19.974603 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-5f0442b9-93a8-464b-a843-39639ca68302 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f" status: 200 len: 1520 microversion: 2.1 time: 0.240509 May 04 19:07:19.975884 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 78/161] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:19 2022] GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f => generated 1520 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:20.025819 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-fd3fe4ad-212b-417d-affd-f2b229973190 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:20.027140 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-fd3fe4ad-212b-417d-affd-f2b229973190 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] [instance: 4c34ec07-a8d6-42d2-b843-d319612cfe2d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:20.033724 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fd3fe4ad-212b-417d-affd-f2b229973190 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:20.034252 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fd3fe4ad-212b-417d-affd-f2b229973190 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:20.035088 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fd3fe4ad-212b-417d-affd-f2b229973190 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:20.035714 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fd3fe4ad-212b-417d-affd-f2b229973190 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:20.104076 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-fd3fe4ad-212b-417d-affd-f2b229973190 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719edb67e8ae41b885581ae3645dd85b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6009c7f43b406e850c819b5b50311c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:20.112037 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-fd3fe4ad-212b-417d-affd-f2b229973190 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] 10.222.0.69 "GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d" status: 200 len: 1346 microversion: 2.1 time: 0.091281 May 04 19:07:20.112686 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 84/162] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:20 2022] GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d => generated 1346 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:20.993659 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-103dab05-ac09-472a-a30b-9dae7845361d tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:20.994503 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-103dab05-ac09-472a-a30b-9dae7845361d tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 4b5bd528-4bc3-4bf3-be31-89364096663f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:21.001950 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-103dab05-ac09-472a-a30b-9dae7845361d tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:21.002383 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-103dab05-ac09-472a-a30b-9dae7845361d tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:21.003160 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-103dab05-ac09-472a-a30b-9dae7845361d tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:21.003634 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-103dab05-ac09-472a-a30b-9dae7845361d tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:21.130660 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-dff310dd-f8d6-4eb9-8032-f02318337799 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:21.131569 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-dff310dd-f8d6-4eb9-8032-f02318337799 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] [instance: 4c34ec07-a8d6-42d2-b843-d319612cfe2d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:21.140935 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-dff310dd-f8d6-4eb9-8032-f02318337799 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:21.142028 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-dff310dd-f8d6-4eb9-8032-f02318337799 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:21.143284 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-dff310dd-f8d6-4eb9-8032-f02318337799 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:21.143890 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-dff310dd-f8d6-4eb9-8032-f02318337799 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:21.160257 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.wsgi [None req-dff310dd-f8d6-4eb9-8032-f02318337799 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] HTTP exception thrown: Instance 4c34ec07-a8d6-42d2-b843-d319612cfe2d could not be found. May 04 19:07:21.161377 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-dff310dd-f8d6-4eb9-8032-f02318337799 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Returning 404 to user: Instance 4c34ec07-a8d6-42d2-b843-d319612cfe2d could not be found. {{(pid=117124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 04 19:07:21.162252 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-dff310dd-f8d6-4eb9-8032-f02318337799 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] 10.222.0.69 "GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d" status: 404 len: 111 microversion: 2.1 time: 0.036489 May 04 19:07:21.162813 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 85/163] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:21 2022] GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 04 19:07:21.166930 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-103dab05-ac09-472a-a30b-9dae7845361d tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:21.174537 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-103dab05-ac09-472a-a30b-9dae7845361d tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f" status: 200 len: 1520 microversion: 2.1 time: 0.186022 May 04 19:07:21.175110 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 79/164] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:20 2022] GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:07:21.290613 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-7b91be9d-b8ca-486c-91c8-0514ad8f0750 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:21.293490 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-7b91be9d-b8ca-486c-91c8-0514ad8f0750 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] [instance: 4c34ec07-a8d6-42d2-b843-d319612cfe2d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:21.304341 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7b91be9d-b8ca-486c-91c8-0514ad8f0750 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:21.306021 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7b91be9d-b8ca-486c-91c8-0514ad8f0750 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:21.307917 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7b91be9d-b8ca-486c-91c8-0514ad8f0750 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:21.309038 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7b91be9d-b8ca-486c-91c8-0514ad8f0750 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:21.335016 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.wsgi [None req-7b91be9d-b8ca-486c-91c8-0514ad8f0750 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] HTTP exception thrown: Instance 4c34ec07-a8d6-42d2-b843-d319612cfe2d could not be found. May 04 19:07:21.335694 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-7b91be9d-b8ca-486c-91c8-0514ad8f0750 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Returning 404 to user: Instance 4c34ec07-a8d6-42d2-b843-d319612cfe2d could not be found. {{(pid=117124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 04 19:07:21.336635 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-7b91be9d-b8ca-486c-91c8-0514ad8f0750 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] 10.222.0.69 "GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.051389 May 04 19:07:21.337278 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 86/165] 10.222.0.69 () {58 vars in 1301 bytes} [Wed May 4 19:07:21 2022] GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d/os-volume_attachments => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 04 19:07:22.192130 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-de2f5dea-1703-470e-b41e-fe783465d97d tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:22.192737 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-de2f5dea-1703-470e-b41e-fe783465d97d tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 4b5bd528-4bc3-4bf3-be31-89364096663f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:22.198550 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-de2f5dea-1703-470e-b41e-fe783465d97d tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:22.198986 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-de2f5dea-1703-470e-b41e-fe783465d97d tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:22.199732 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-de2f5dea-1703-470e-b41e-fe783465d97d tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:22.200173 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-de2f5dea-1703-470e-b41e-fe783465d97d tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:22.329388 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-de2f5dea-1703-470e-b41e-fe783465d97d tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:22.337244 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-de2f5dea-1703-470e-b41e-fe783465d97d tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f" status: 200 len: 1520 microversion: 2.1 time: 0.148521 May 04 19:07:22.337845 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 80/166] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:22 2022] GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:22.552532 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-6a11c4a3-b089-4cfb-98c7-f6aae46b039e tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:22.553154 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-6a11c4a3-b089-4cfb-98c7-f6aae46b039e tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] [instance: 4c34ec07-a8d6-42d2-b843-d319612cfe2d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:22.559578 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6a11c4a3-b089-4cfb-98c7-f6aae46b039e tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:22.560022 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6a11c4a3-b089-4cfb-98c7-f6aae46b039e tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:22.560786 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6a11c4a3-b089-4cfb-98c7-f6aae46b039e tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:22.561217 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6a11c4a3-b089-4cfb-98c7-f6aae46b039e tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:22.574746 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.wsgi [None req-6a11c4a3-b089-4cfb-98c7-f6aae46b039e tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] HTTP exception thrown: Instance 4c34ec07-a8d6-42d2-b843-d319612cfe2d could not be found. May 04 19:07:22.575327 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-6a11c4a3-b089-4cfb-98c7-f6aae46b039e tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Returning 404 to user: Instance 4c34ec07-a8d6-42d2-b843-d319612cfe2d could not be found. {{(pid=117124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 04 19:07:22.576142 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-6a11c4a3-b089-4cfb-98c7-f6aae46b039e tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] 10.222.0.69 "DELETE /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d" status: 404 len: 111 microversion: 2.1 time: 0.028180 May 04 19:07:22.576665 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 87/167] 10.222.0.69 () {58 vars in 1238 bytes} [Wed May 4 19:07:22 2022] DELETE /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 04 19:07:22.584577 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-d1ef559c-bddc-4ccb-b88e-130e43958db2 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:22.585185 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-d1ef559c-bddc-4ccb-b88e-130e43958db2 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] [instance: 4c34ec07-a8d6-42d2-b843-d319612cfe2d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:22.591785 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d1ef559c-bddc-4ccb-b88e-130e43958db2 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:22.592229 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d1ef559c-bddc-4ccb-b88e-130e43958db2 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:22.592986 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d1ef559c-bddc-4ccb-b88e-130e43958db2 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:22.593419 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d1ef559c-bddc-4ccb-b88e-130e43958db2 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:22.606452 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.wsgi [None req-d1ef559c-bddc-4ccb-b88e-130e43958db2 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] HTTP exception thrown: Instance 4c34ec07-a8d6-42d2-b843-d319612cfe2d could not be found. May 04 19:07:22.607029 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-d1ef559c-bddc-4ccb-b88e-130e43958db2 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] Returning 404 to user: Instance 4c34ec07-a8d6-42d2-b843-d319612cfe2d could not be found. {{(pid=117125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 04 19:07:22.607831 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-d1ef559c-bddc-4ccb-b88e-130e43958db2 tempest-DeleteServersTestJSON-1840478287 tempest-DeleteServersTestJSON-1840478287-project] 10.222.0.69 "GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d" status: 404 len: 111 microversion: 2.1 time: 0.027061 May 04 19:07:22.608346 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 81/168] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:22 2022] GET /compute/v2.1/servers/4c34ec07-a8d6-42d2-b843-d319612cfe2d => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 04 19:07:23.354686 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-57a75728-c432-4f9c-bc92-492958367581 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:23.355295 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-57a75728-c432-4f9c-bc92-492958367581 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 4b5bd528-4bc3-4bf3-be31-89364096663f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:23.361040 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-57a75728-c432-4f9c-bc92-492958367581 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:23.361512 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-57a75728-c432-4f9c-bc92-492958367581 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:23.362280 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-57a75728-c432-4f9c-bc92-492958367581 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:23.362710 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-57a75728-c432-4f9c-bc92-492958367581 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:23.513996 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-57a75728-c432-4f9c-bc92-492958367581 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:23.521484 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-57a75728-c432-4f9c-bc92-492958367581 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f" status: 200 len: 1520 microversion: 2.1 time: 0.171170 May 04 19:07:23.522070 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 88/169] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:23 2022] GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:24.538954 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-9fb79614-053f-40a6-bd1d-c8f2015bdae8 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:24.540194 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-9fb79614-053f-40a6-bd1d-c8f2015bdae8 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 4b5bd528-4bc3-4bf3-be31-89364096663f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:24.546277 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9fb79614-053f-40a6-bd1d-c8f2015bdae8 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:24.546998 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9fb79614-053f-40a6-bd1d-c8f2015bdae8 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:24.547949 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9fb79614-053f-40a6-bd1d-c8f2015bdae8 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:24.548578 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9fb79614-053f-40a6-bd1d-c8f2015bdae8 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:24.730876 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-9fb79614-053f-40a6-bd1d-c8f2015bdae8 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:24.744265 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-9fb79614-053f-40a6-bd1d-c8f2015bdae8 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f" status: 200 len: 1520 microversion: 2.1 time: 0.209137 May 04 19:07:24.746165 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 82/170] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:24 2022] GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f => generated 1520 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:25.763542 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-311207f9-48de-4b51-b6fe-616975e05dda tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:25.764659 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-311207f9-48de-4b51-b6fe-616975e05dda tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 4b5bd528-4bc3-4bf3-be31-89364096663f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:25.773205 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-311207f9-48de-4b51-b6fe-616975e05dda tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:25.773741 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-311207f9-48de-4b51-b6fe-616975e05dda tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:25.774849 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-311207f9-48de-4b51-b6fe-616975e05dda tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:25.775433 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-311207f9-48de-4b51-b6fe-616975e05dda tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:25.985774 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-311207f9-48de-4b51-b6fe-616975e05dda tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:26.005504 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-311207f9-48de-4b51-b6fe-616975e05dda tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f" status: 200 len: 1520 microversion: 2.1 time: 0.237535 May 04 19:07:26.005504 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 89/171] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:25 2022] GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f => generated 1520 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:27.015745 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-e7a1fb7f-853a-462c-aebd-1a598beafa33 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:27.016972 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-e7a1fb7f-853a-462c-aebd-1a598beafa33 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 4b5bd528-4bc3-4bf3-be31-89364096663f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:27.023628 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e7a1fb7f-853a-462c-aebd-1a598beafa33 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:27.024163 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e7a1fb7f-853a-462c-aebd-1a598beafa33 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:27.024932 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e7a1fb7f-853a-462c-aebd-1a598beafa33 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:27.025365 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e7a1fb7f-853a-462c-aebd-1a598beafa33 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:27.207441 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-e7a1fb7f-853a-462c-aebd-1a598beafa33 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:27.215949 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-e7a1fb7f-853a-462c-aebd-1a598beafa33 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f" status: 200 len: 1520 microversion: 2.1 time: 0.204174 May 04 19:07:27.236526 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 83/172] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:27 2022] GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f => generated 1520 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:28.234059 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-46ea9289-983d-460c-b9de-786232dba986 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:28.234970 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-46ea9289-983d-460c-b9de-786232dba986 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 4b5bd528-4bc3-4bf3-be31-89364096663f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:28.242332 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-46ea9289-983d-460c-b9de-786232dba986 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:28.243649 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-46ea9289-983d-460c-b9de-786232dba986 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:28.244478 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-46ea9289-983d-460c-b9de-786232dba986 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:28.245071 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-46ea9289-983d-460c-b9de-786232dba986 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:28.558181 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-46ea9289-983d-460c-b9de-786232dba986 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:28.570314 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-46ea9289-983d-460c-b9de-786232dba986 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f" status: 200 len: 1520 microversion: 2.1 time: 0.340237 May 04 19:07:28.572688 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 90/173] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:28 2022] GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f => generated 1520 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:29.252856 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-0ed67d67-ab18-4eba-aa78-de2e504be4da tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Action: 'create', calling method: .version_select at 0x7fc3f6d1c4c0>, body: {"keypair": {"name": "tempest-keypair-106439882"}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:07:29.272198 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-0ed67d67-ab18-4eba-aa78-de2e504be4da tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Getting quotas for project ef1ba9318cf84308a3ff6ce6da85755d. Resources: {'key_pairs'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 04 19:07:29.276088 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-0ed67d67-ab18-4eba-aa78-de2e504be4da tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Getting quotas for user 98211cfafca84542a64f8b3f0b34303b and project ef1ba9318cf84308a3ff6ce6da85755d. Resources: {'key_pairs'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 04 19:07:29.438860 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-0ed67d67-ab18-4eba-aa78-de2e504be4da tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Getting quotas for project ef1ba9318cf84308a3ff6ce6da85755d. Resources: {'key_pairs'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 04 19:07:29.442479 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-0ed67d67-ab18-4eba-aa78-de2e504be4da tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Getting quotas for user 98211cfafca84542a64f8b3f0b34303b and project ef1ba9318cf84308a3ff6ce6da85755d. Resources: {'key_pairs'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 04 19:07:29.455433 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-0ed67d67-ab18-4eba-aa78-de2e504be4da tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.320291 May 04 19:07:29.456030 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 84/174] 10.222.0.69 () {60 vars in 1157 bytes} [Wed May 4 19:07:29 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:29.588675 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-eb8ac20a-8910-4a2a-afeb-17c297186cba tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:29.590753 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-eb8ac20a-8910-4a2a-afeb-17c297186cba tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 4b5bd528-4bc3-4bf3-be31-89364096663f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:29.597011 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-eb8ac20a-8910-4a2a-afeb-17c297186cba tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:29.597682 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-eb8ac20a-8910-4a2a-afeb-17c297186cba tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:29.598459 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-eb8ac20a-8910-4a2a-afeb-17c297186cba tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:29.598889 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-eb8ac20a-8910-4a2a-afeb-17c297186cba tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:29.780183 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-eb8ac20a-8910-4a2a-afeb-17c297186cba tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:29.788689 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-eb8ac20a-8910-4a2a-afeb-17c297186cba tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f" status: 200 len: 1520 microversion: 2.1 time: 0.204540 May 04 19:07:29.789283 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 91/175] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:29 2022] GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f => generated 1520 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:30.806170 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-93030d62-40a4-42cd-baf8-67b7acdba558 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:30.806774 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-93030d62-40a4-42cd-baf8-67b7acdba558 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 4b5bd528-4bc3-4bf3-be31-89364096663f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:30.813431 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-93030d62-40a4-42cd-baf8-67b7acdba558 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:30.814035 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-93030d62-40a4-42cd-baf8-67b7acdba558 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:30.814863 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-93030d62-40a4-42cd-baf8-67b7acdba558 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:30.815383 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-93030d62-40a4-42cd-baf8-67b7acdba558 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:30.963503 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-93030d62-40a4-42cd-baf8-67b7acdba558 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:30.972961 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-93030d62-40a4-42cd-baf8-67b7acdba558 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f" status: 200 len: 1520 microversion: 2.1 time: 0.170685 May 04 19:07:30.974176 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 85/176] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:30 2022] GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:31.053451 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-296aced9-72ad-4486-9b8f-1a3d3bd37b4d tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1230245007", "imageRef": "2869595e-cda4-45af-aaeb-0779eb5f4114", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "52743f3b-665f-4119-9451-8ab735a2cc02"}], "security_groups": [{"name": "tempest-securitygroup--1859800938"}], "key_name": "tempest-keypair-106439882", "user_data": "}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:07:31.194875 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.network.neutron [None req-296aced9-72ad-4486-9b8f-1a3d3bd37b4d tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] validate_networks() for [('52743f3b-665f-4119-9451-8ab735a2cc02', None, None, None, None, None)] {{(pid=117124) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 04 19:07:31.852733 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-296aced9-72ad-4486-9b8f-1a3d3bd37b4d tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Flavor limits 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 04 19:07:31.853151 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-296aced9-72ad-4486-9b8f-1a3d3bd37b4d tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Image limits 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 04 19:07:31.853647 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-296aced9-72ad-4486-9b8f-1a3d3bd37b4d tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Flavor pref 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 04 19:07:31.854053 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-296aced9-72ad-4486-9b8f-1a3d3bd37b4d tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Image pref 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 04 19:07:31.854455 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-296aced9-72ad-4486-9b8f-1a3d3bd37b4d tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 04 19:07:31.865774 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-296aced9-72ad-4486-9b8f-1a3d3bd37b4d tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:31.866652 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-296aced9-72ad-4486-9b8f-1a3d3bd37b4d tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:31.868131 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-296aced9-72ad-4486-9b8f-1a3d3bd37b4d tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:31.868563 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-296aced9-72ad-4486-9b8f-1a3d3bd37b4d tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:31.891459 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-296aced9-72ad-4486-9b8f-1a3d3bd37b4d tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Getting quotas for project ef1ba9318cf84308a3ff6ce6da85755d. Resources: {'cores', 'ram', 'instances'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 04 19:07:31.896106 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-296aced9-72ad-4486-9b8f-1a3d3bd37b4d tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Getting quotas for user 98211cfafca84542a64f8b3f0b34303b and project ef1ba9318cf84308a3ff6ce6da85755d. Resources: {'cores', 'ram', 'instances'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 04 19:07:31.908425 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-296aced9-72ad-4486-9b8f-1a3d3bd37b4d tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Going to run 1 instances... {{(pid=117124) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 04 19:07:31.911428 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-296aced9-72ad-4486-9b8f-1a3d3bd37b4d tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: fae4a97e-a910-4f71-abf2-8f62425c6a52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2869595e-cda4-45af-aaeb-0779eb5f4114',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 04 19:07:31.990312 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-c89baa7f-cc45-4fed-9016-102961a74ddf tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:31.990929 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-c89baa7f-cc45-4fed-9016-102961a74ddf tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 4b5bd528-4bc3-4bf3-be31-89364096663f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:31.991945 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-296aced9-72ad-4486-9b8f-1a3d3bd37b4d tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.943252 May 04 19:07:31.993650 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 92/177] 10.222.0.69 () {60 vars in 1146 bytes} [Wed May 4 19:07:31 2022] POST /compute/v2.1/servers => generated 402 bytes in 946 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 04 19:07:32.004676 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-46df271e-a3f7-4a67-812c-6b14403764d3 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:32.005086 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c89baa7f-cc45-4fed-9016-102961a74ddf tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:32.005748 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c89baa7f-cc45-4fed-9016-102961a74ddf tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:32.006668 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-46df271e-a3f7-4a67-812c-6b14403764d3 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: fae4a97e-a910-4f71-abf2-8f62425c6a52] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:32.006834 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c89baa7f-cc45-4fed-9016-102961a74ddf tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:32.007412 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c89baa7f-cc45-4fed-9016-102961a74ddf tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:32.116809 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-46df271e-a3f7-4a67-812c-6b14403764d3 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:32.124534 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-46df271e-a3f7-4a67-812c-6b14403764d3 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/fae4a97e-a910-4f71-abf2-8f62425c6a52" status: 200 len: 1241 microversion: 2.1 time: 0.124496 May 04 19:07:32.125446 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 93/178] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:31 2022] GET /compute/v2.1/servers/fae4a97e-a910-4f71-abf2-8f62425c6a52 => generated 1241 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:32.196883 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-c89baa7f-cc45-4fed-9016-102961a74ddf tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:32.204866 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-c89baa7f-cc45-4fed-9016-102961a74ddf tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f" status: 200 len: 1520 microversion: 2.1 time: 0.218548 May 04 19:07:32.205923 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 86/179] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:31 2022] GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f => generated 1520 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:07:33.141557 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-089b7cd9-b694-481c-bbb5-e3721be8adad tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:33.142538 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-089b7cd9-b694-481c-bbb5-e3721be8adad tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: fae4a97e-a910-4f71-abf2-8f62425c6a52] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:33.150115 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-089b7cd9-b694-481c-bbb5-e3721be8adad tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:33.150859 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-089b7cd9-b694-481c-bbb5-e3721be8adad tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:33.151717 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-089b7cd9-b694-481c-bbb5-e3721be8adad tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:33.152264 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-089b7cd9-b694-481c-bbb5-e3721be8adad tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:33.220099 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-089b7cd9-b694-481c-bbb5-e3721be8adad tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:33.222169 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-8376f68e-d97e-47a2-89a8-7b2fd2db787c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:33.223288 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-8376f68e-d97e-47a2-89a8-7b2fd2db787c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 4b5bd528-4bc3-4bf3-be31-89364096663f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:33.229064 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-089b7cd9-b694-481c-bbb5-e3721be8adad tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/fae4a97e-a910-4f71-abf2-8f62425c6a52" status: 200 len: 1293 microversion: 2.1 time: 0.091285 May 04 19:07:33.229853 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 94/180] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:33 2022] GET /compute/v2.1/servers/fae4a97e-a910-4f71-abf2-8f62425c6a52 => generated 1293 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:33.229963 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8376f68e-d97e-47a2-89a8-7b2fd2db787c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:33.230329 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8376f68e-d97e-47a2-89a8-7b2fd2db787c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:33.231103 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8376f68e-d97e-47a2-89a8-7b2fd2db787c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:33.231535 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8376f68e-d97e-47a2-89a8-7b2fd2db787c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:33.622456 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-8376f68e-d97e-47a2-89a8-7b2fd2db787c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:33.629938 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-8376f68e-d97e-47a2-89a8-7b2fd2db787c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f" status: 200 len: 1520 microversion: 2.1 time: 0.411474 May 04 19:07:33.630513 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 87/181] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:33 2022] GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f => generated 1520 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:34.247353 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-73b1c9e1-c3ae-4403-ad4a-96455cfa1ae9 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:34.247964 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-73b1c9e1-c3ae-4403-ad4a-96455cfa1ae9 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: fae4a97e-a910-4f71-abf2-8f62425c6a52] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:34.254198 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-73b1c9e1-c3ae-4403-ad4a-96455cfa1ae9 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:34.254636 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-73b1c9e1-c3ae-4403-ad4a-96455cfa1ae9 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:34.255395 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-73b1c9e1-c3ae-4403-ad4a-96455cfa1ae9 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:34.255822 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-73b1c9e1-c3ae-4403-ad4a-96455cfa1ae9 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:34.324353 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-73b1c9e1-c3ae-4403-ad4a-96455cfa1ae9 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:34.332101 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-73b1c9e1-c3ae-4403-ad4a-96455cfa1ae9 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/fae4a97e-a910-4f71-abf2-8f62425c6a52" status: 200 len: 1299 microversion: 2.1 time: 0.088587 May 04 19:07:34.332792 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 95/182] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:34 2022] GET /compute/v2.1/servers/fae4a97e-a910-4f71-abf2-8f62425c6a52 => generated 1299 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:07:34.649287 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-07bb1711-b6cb-42d9-a56a-0bf3f7022715 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:34.650102 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-07bb1711-b6cb-42d9-a56a-0bf3f7022715 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 4b5bd528-4bc3-4bf3-be31-89364096663f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:34.656677 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-07bb1711-b6cb-42d9-a56a-0bf3f7022715 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:34.657262 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-07bb1711-b6cb-42d9-a56a-0bf3f7022715 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:34.658162 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-07bb1711-b6cb-42d9-a56a-0bf3f7022715 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:34.658691 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-07bb1711-b6cb-42d9-a56a-0bf3f7022715 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:34.951582 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-07bb1711-b6cb-42d9-a56a-0bf3f7022715 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:34.961673 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-07bb1711-b6cb-42d9-a56a-0bf3f7022715 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f" status: 200 len: 1520 microversion: 2.1 time: 0.315150 May 04 19:07:34.962827 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 88/183] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:34 2022] GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f => generated 1520 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:35.349688 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-a1ab4e9e-c752-438d-967f-f0d450887cae tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:35.359961 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-a1ab4e9e-c752-438d-967f-f0d450887cae tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: fae4a97e-a910-4f71-abf2-8f62425c6a52] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:35.375226 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a1ab4e9e-c752-438d-967f-f0d450887cae tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:35.375673 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a1ab4e9e-c752-438d-967f-f0d450887cae tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:35.376456 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a1ab4e9e-c752-438d-967f-f0d450887cae tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:35.376882 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a1ab4e9e-c752-438d-967f-f0d450887cae tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:35.379776 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-399123c5-710c-4e33-9def-b7d14f83d02b req-ae1a4a54-75cd-46a9-a85d-51b941168cf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fae4a97e-a910-4f71-abf2-8f62425c6a52", "tag": "8a90cb33-99be-414d-99e2-31861f252bb4"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:07:35.391641 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-399123c5-710c-4e33-9def-b7d14f83d02b req-ae1a4a54-75cd-46a9-a85d-51b941168cf7 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:35.393896 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-399123c5-710c-4e33-9def-b7d14f83d02b req-ae1a4a54-75cd-46a9-a85d-51b941168cf7 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:35.413220 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-399123c5-710c-4e33-9def-b7d14f83d02b req-ae1a4a54-75cd-46a9-a85d-51b941168cf7 service nova] Creating event network-changed:8a90cb33-99be-414d-99e2-31861f252bb4 for instance fae4a97e-a910-4f71-abf2-8f62425c6a52 on hv-cinder-83090 May 04 19:07:35.426375 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-399123c5-710c-4e33-9def-b7d14f83d02b req-ae1a4a54-75cd-46a9-a85d-51b941168cf7 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053020 May 04 19:07:35.427008 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 89/184] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:07:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 04 19:07:35.581230 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-a1ab4e9e-c752-438d-967f-f0d450887cae tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:35.592145 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-a1ab4e9e-c752-438d-967f-f0d450887cae tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/fae4a97e-a910-4f71-abf2-8f62425c6a52" status: 200 len: 1367 microversion: 2.1 time: 0.243279 May 04 19:07:35.592932 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 96/185] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:35 2022] GET /compute/v2.1/servers/fae4a97e-a910-4f71-abf2-8f62425c6a52 => generated 1367 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:35.979222 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-02313a5c-6c18-45b3-8a7a-e2c192fac48c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:35.979955 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-02313a5c-6c18-45b3-8a7a-e2c192fac48c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 4b5bd528-4bc3-4bf3-be31-89364096663f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:35.986196 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-02313a5c-6c18-45b3-8a7a-e2c192fac48c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:35.986643 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-02313a5c-6c18-45b3-8a7a-e2c192fac48c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:35.987410 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-02313a5c-6c18-45b3-8a7a-e2c192fac48c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:35.987849 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-02313a5c-6c18-45b3-8a7a-e2c192fac48c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:36.133517 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-02313a5c-6c18-45b3-8a7a-e2c192fac48c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:36.143997 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-02313a5c-6c18-45b3-8a7a-e2c192fac48c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f" status: 200 len: 1520 microversion: 2.1 time: 0.169443 May 04 19:07:36.144682 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 90/186] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:35 2022] GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:36.608018 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-3f5e1cfa-aa20-4aa1-b89c-0a7b9f8dc07d tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:36.608632 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-3f5e1cfa-aa20-4aa1-b89c-0a7b9f8dc07d tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: fae4a97e-a910-4f71-abf2-8f62425c6a52] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:36.615130 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3f5e1cfa-aa20-4aa1-b89c-0a7b9f8dc07d tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:36.615586 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3f5e1cfa-aa20-4aa1-b89c-0a7b9f8dc07d tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:36.616448 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3f5e1cfa-aa20-4aa1-b89c-0a7b9f8dc07d tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:36.616885 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3f5e1cfa-aa20-4aa1-b89c-0a7b9f8dc07d tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:36.751826 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-3f5e1cfa-aa20-4aa1-b89c-0a7b9f8dc07d tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:36.759416 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-3f5e1cfa-aa20-4aa1-b89c-0a7b9f8dc07d tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/fae4a97e-a910-4f71-abf2-8f62425c6a52" status: 200 len: 1367 microversion: 2.1 time: 0.155171 May 04 19:07:36.759984 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 97/187] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:36 2022] GET /compute/v2.1/servers/fae4a97e-a910-4f71-abf2-8f62425c6a52 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:36.886391 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-44360379-58aa-430f-b8f3-2a763a376984 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-539487280", "imageRef": "2869595e-cda4-45af-aaeb-0779eb5f4114", "flavorRef": "452", "networks": [{"uuid": "214827e4-722a-43f1-9800-70bea389524e"}]}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:07:36.937636 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.network.neutron [None req-44360379-58aa-430f-b8f3-2a763a376984 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] validate_networks() for [('214827e4-722a-43f1-9800-70bea389524e', None, None, None, None, None)] {{(pid=117125) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 04 19:07:37.163254 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-710220c1-ba34-4724-a13d-de2b3c0ef6c0 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:37.163898 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-710220c1-ba34-4724-a13d-de2b3c0ef6c0 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 4b5bd528-4bc3-4bf3-be31-89364096663f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:37.170082 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-710220c1-ba34-4724-a13d-de2b3c0ef6c0 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:37.170533 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-710220c1-ba34-4724-a13d-de2b3c0ef6c0 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:37.171306 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-710220c1-ba34-4724-a13d-de2b3c0ef6c0 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:37.171916 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-710220c1-ba34-4724-a13d-de2b3c0ef6c0 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:37.318518 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-710220c1-ba34-4724-a13d-de2b3c0ef6c0 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:37.326499 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-710220c1-ba34-4724-a13d-de2b3c0ef6c0 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f" status: 200 len: 1520 microversion: 2.1 time: 0.167655 May 04 19:07:37.327184 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 98/188] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:37 2022] GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:07:37.457242 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-44360379-58aa-430f-b8f3-2a763a376984 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Flavor limits 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 04 19:07:37.457804 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-44360379-58aa-430f-b8f3-2a763a376984 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Image limits 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 04 19:07:37.458320 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-44360379-58aa-430f-b8f3-2a763a376984 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Flavor pref 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 04 19:07:37.458795 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-44360379-58aa-430f-b8f3-2a763a376984 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Image pref 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 04 19:07:37.459274 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-44360379-58aa-430f-b8f3-2a763a376984 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 04 19:07:37.470318 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-44360379-58aa-430f-b8f3-2a763a376984 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:37.470823 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-44360379-58aa-430f-b8f3-2a763a376984 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:37.471636 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-44360379-58aa-430f-b8f3-2a763a376984 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:37.472079 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-44360379-58aa-430f-b8f3-2a763a376984 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:37.488952 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-44360379-58aa-430f-b8f3-2a763a376984 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Getting quotas for project 253bbd0defee4faf92eb8453dd4728fa. Resources: {'cores', 'ram', 'instances'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 04 19:07:37.493508 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-44360379-58aa-430f-b8f3-2a763a376984 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Getting quotas for user 1298cdaba25f478a9ae358f87942ce8b and project 253bbd0defee4faf92eb8453dd4728fa. Resources: {'cores', 'ram', 'instances'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 04 19:07:37.504392 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-44360379-58aa-430f-b8f3-2a763a376984 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Going to run 1 instances... {{(pid=117125) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 04 19:07:37.506681 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-44360379-58aa-430f-b8f3-2a763a376984 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] [instance: 384b5f38-404a-478e-ba5e-af5e706841b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2869595e-cda4-45af-aaeb-0779eb5f4114',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 04 19:07:37.556522 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-44360379-58aa-430f-b8f3-2a763a376984 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.674931 May 04 19:07:37.562265 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 91/189] 10.222.0.69 () {60 vars in 1146 bytes} [Wed May 4 19:07:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 04 19:07:37.567365 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-8c4f51f6-3573-4a6b-8cd0-7effb5e6a38f tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:37.568029 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-8c4f51f6-3573-4a6b-8cd0-7effb5e6a38f tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] [instance: 384b5f38-404a-478e-ba5e-af5e706841b3] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:37.629981 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-8c4f51f6-3573-4a6b-8cd0-7effb5e6a38f tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1298cdaba25f478a9ae358f87942ce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253bbd0defee4faf92eb8453dd4728fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:37.638279 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-8c4f51f6-3573-4a6b-8cd0-7effb5e6a38f tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] 10.222.0.69 "GET /compute/v2.1/servers/384b5f38-404a-478e-ba5e-af5e706841b3" status: 200 len: 1213 microversion: 2.1 time: 0.074601 May 04 19:07:37.638870 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 99/190] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:37 2022] GET /compute/v2.1/servers/384b5f38-404a-478e-ba5e-af5e706841b3 => generated 1213 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:37.776493 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-28f41e58-b409-4733-b705-df5e940a5c67 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:37.777257 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-28f41e58-b409-4733-b705-df5e940a5c67 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: fae4a97e-a910-4f71-abf2-8f62425c6a52] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:37.783371 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-28f41e58-b409-4733-b705-df5e940a5c67 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:37.783929 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-28f41e58-b409-4733-b705-df5e940a5c67 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:37.784831 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-28f41e58-b409-4733-b705-df5e940a5c67 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:37.785370 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-28f41e58-b409-4733-b705-df5e940a5c67 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:38.069793 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-28f41e58-b409-4733-b705-df5e940a5c67 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:38.078271 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-28f41e58-b409-4733-b705-df5e940a5c67 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/fae4a97e-a910-4f71-abf2-8f62425c6a52" status: 200 len: 1367 microversion: 2.1 time: 0.306045 May 04 19:07:38.078874 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 92/191] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:37 2022] GET /compute/v2.1/servers/fae4a97e-a910-4f71-abf2-8f62425c6a52 => generated 1367 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:38.343446 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-930404ae-d81c-430d-9061-813c6628003a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:38.344609 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-930404ae-d81c-430d-9061-813c6628003a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 4b5bd528-4bc3-4bf3-be31-89364096663f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:38.350878 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-930404ae-d81c-430d-9061-813c6628003a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:38.351352 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-930404ae-d81c-430d-9061-813c6628003a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:38.352324 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-930404ae-d81c-430d-9061-813c6628003a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:38.352923 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-930404ae-d81c-430d-9061-813c6628003a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:38.507441 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-930404ae-d81c-430d-9061-813c6628003a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:38.516786 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-930404ae-d81c-430d-9061-813c6628003a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f" status: 200 len: 1520 microversion: 2.1 time: 0.177250 May 04 19:07:38.517835 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 100/192] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:38 2022] GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:38.655694 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-51f9ba93-841e-48c7-a19c-846d1af8b28b tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:38.656398 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-51f9ba93-841e-48c7-a19c-846d1af8b28b tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] [instance: 384b5f38-404a-478e-ba5e-af5e706841b3] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:38.662900 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-51f9ba93-841e-48c7-a19c-846d1af8b28b tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:38.663429 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-51f9ba93-841e-48c7-a19c-846d1af8b28b tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:38.664328 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-51f9ba93-841e-48c7-a19c-846d1af8b28b tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:38.664844 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-51f9ba93-841e-48c7-a19c-846d1af8b28b tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:38.731273 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-51f9ba93-841e-48c7-a19c-846d1af8b28b tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1298cdaba25f478a9ae358f87942ce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253bbd0defee4faf92eb8453dd4728fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:38.739041 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-51f9ba93-841e-48c7-a19c-846d1af8b28b tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] 10.222.0.69 "GET /compute/v2.1/servers/384b5f38-404a-478e-ba5e-af5e706841b3" status: 200 len: 1265 microversion: 2.1 time: 0.087219 May 04 19:07:38.739884 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 93/193] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:38 2022] GET /compute/v2.1/servers/384b5f38-404a-478e-ba5e-af5e706841b3 => generated 1265 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:39.095193 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-54f36246-7eff-438f-9759-f265ceefc4ad tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:39.095716 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-54f36246-7eff-438f-9759-f265ceefc4ad tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: fae4a97e-a910-4f71-abf2-8f62425c6a52] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:39.102974 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-54f36246-7eff-438f-9759-f265ceefc4ad tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:39.103525 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-54f36246-7eff-438f-9759-f265ceefc4ad tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:39.104290 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-54f36246-7eff-438f-9759-f265ceefc4ad tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:39.104716 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-54f36246-7eff-438f-9759-f265ceefc4ad tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:39.236943 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-54f36246-7eff-438f-9759-f265ceefc4ad tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:39.244969 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-54f36246-7eff-438f-9759-f265ceefc4ad tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/fae4a97e-a910-4f71-abf2-8f62425c6a52" status: 200 len: 1367 microversion: 2.1 time: 0.153509 May 04 19:07:39.245581 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 101/194] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:39 2022] GET /compute/v2.1/servers/fae4a97e-a910-4f71-abf2-8f62425c6a52 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:39.534013 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-e26ad893-154a-408e-822f-382d93658e53 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:39.534628 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-e26ad893-154a-408e-822f-382d93658e53 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 4b5bd528-4bc3-4bf3-be31-89364096663f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:39.540821 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e26ad893-154a-408e-822f-382d93658e53 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:39.541275 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e26ad893-154a-408e-822f-382d93658e53 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:39.542069 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e26ad893-154a-408e-822f-382d93658e53 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:39.542509 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e26ad893-154a-408e-822f-382d93658e53 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:39.758438 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-39bc308f-ed69-440e-a752-22543b50c6f2 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:39.759121 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-39bc308f-ed69-440e-a752-22543b50c6f2 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] [instance: 384b5f38-404a-478e-ba5e-af5e706841b3] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:39.762811 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-e26ad893-154a-408e-822f-382d93658e53 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:39.766377 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-39bc308f-ed69-440e-a752-22543b50c6f2 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:39.766795 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-39bc308f-ed69-440e-a752-22543b50c6f2 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:39.767947 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-39bc308f-ed69-440e-a752-22543b50c6f2 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:39.768387 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-39bc308f-ed69-440e-a752-22543b50c6f2 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:39.774092 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-e26ad893-154a-408e-822f-382d93658e53 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f" status: 200 len: 1520 microversion: 2.1 time: 0.241891 May 04 19:07:39.774092 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 94/195] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:39 2022] GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f => generated 1520 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:39.905399 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-39bc308f-ed69-440e-a752-22543b50c6f2 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1298cdaba25f478a9ae358f87942ce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253bbd0defee4faf92eb8453dd4728fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:39.913040 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-39bc308f-ed69-440e-a752-22543b50c6f2 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] 10.222.0.69 "GET /compute/v2.1/servers/384b5f38-404a-478e-ba5e-af5e706841b3" status: 200 len: 1313 microversion: 2.1 time: 0.160115 May 04 19:07:39.922684 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 102/196] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:39 2022] GET /compute/v2.1/servers/384b5f38-404a-478e-ba5e-af5e706841b3 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:07:39.937724 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-27e3ff74-4010-44aa-8562-2e22a5809ce1 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1831793603", "imageRef": "2869595e-cda4-45af-aaeb-0779eb5f4114", "flavorRef": "452", "networks": [{"uuid": "5d74b4ea-3f57-4f2d-b82a-88a7a6abbbaa"}]}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:07:39.987348 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.network.neutron [None req-27e3ff74-4010-44aa-8562-2e22a5809ce1 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] validate_networks() for [('5d74b4ea-3f57-4f2d-b82a-88a7a6abbbaa', None, None, None, None, None)] {{(pid=117125) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 04 19:07:40.262424 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-495e2eea-4c2d-4f3c-8577-6d63fd88673d tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:40.263183 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-495e2eea-4c2d-4f3c-8577-6d63fd88673d tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: fae4a97e-a910-4f71-abf2-8f62425c6a52] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:40.270156 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-495e2eea-4c2d-4f3c-8577-6d63fd88673d tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:40.270678 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-495e2eea-4c2d-4f3c-8577-6d63fd88673d tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:40.271511 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-495e2eea-4c2d-4f3c-8577-6d63fd88673d tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:40.272008 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-495e2eea-4c2d-4f3c-8577-6d63fd88673d tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:40.423063 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-495e2eea-4c2d-4f3c-8577-6d63fd88673d tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:40.431170 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-495e2eea-4c2d-4f3c-8577-6d63fd88673d tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/fae4a97e-a910-4f71-abf2-8f62425c6a52" status: 200 len: 1367 microversion: 2.1 time: 0.172492 May 04 19:07:40.431877 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 103/197] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:40 2022] GET /compute/v2.1/servers/fae4a97e-a910-4f71-abf2-8f62425c6a52 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:07:40.546666 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-27e3ff74-4010-44aa-8562-2e22a5809ce1 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Flavor limits 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 04 19:07:40.548476 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-27e3ff74-4010-44aa-8562-2e22a5809ce1 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Image limits 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 04 19:07:40.549154 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-27e3ff74-4010-44aa-8562-2e22a5809ce1 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Flavor pref 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 04 19:07:40.557704 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-27e3ff74-4010-44aa-8562-2e22a5809ce1 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Image pref 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 04 19:07:40.558226 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-27e3ff74-4010-44aa-8562-2e22a5809ce1 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 04 19:07:40.565219 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-e9e1dd83-9ecb-4652-9f8b-44ed1edf3d1d req-664a616b-39a5-4a5a-97db-add6295ccbd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "384b5f38-404a-478e-ba5e-af5e706841b3", "tag": "dac54407-f56f-4462-8538-3a40734619d0"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:07:40.572203 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-27e3ff74-4010-44aa-8562-2e22a5809ce1 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:40.573436 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-27e3ff74-4010-44aa-8562-2e22a5809ce1 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:40.573875 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-e9e1dd83-9ecb-4652-9f8b-44ed1edf3d1d req-664a616b-39a5-4a5a-97db-add6295ccbd2 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:40.574363 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-e9e1dd83-9ecb-4652-9f8b-44ed1edf3d1d req-664a616b-39a5-4a5a-97db-add6295ccbd2 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:40.575180 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-27e3ff74-4010-44aa-8562-2e22a5809ce1 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:40.575882 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-27e3ff74-4010-44aa-8562-2e22a5809ce1 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:40.588187 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-e9e1dd83-9ecb-4652-9f8b-44ed1edf3d1d req-664a616b-39a5-4a5a-97db-add6295ccbd2 service nova] Creating event network-changed:dac54407-f56f-4462-8538-3a40734619d0 for instance 384b5f38-404a-478e-ba5e-af5e706841b3 on hv-cinder-83090 May 04 19:07:40.593049 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-e9e1dd83-9ecb-4652-9f8b-44ed1edf3d1d req-664a616b-39a5-4a5a-97db-add6295ccbd2 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031595 May 04 19:07:40.593987 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 104/198] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 04 19:07:40.599248 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-27e3ff74-4010-44aa-8562-2e22a5809ce1 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Getting quotas for project fedb3ef21b1e413395b1a4cdcfb3f4d6. Resources: {'cores', 'ram', 'instances'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 04 19:07:40.603631 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-27e3ff74-4010-44aa-8562-2e22a5809ce1 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Getting quotas for user 632af5ddc209419a93461afdb070fc87 and project fedb3ef21b1e413395b1a4cdcfb3f4d6. Resources: {'cores', 'ram', 'instances'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 04 19:07:40.615274 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-27e3ff74-4010-44aa-8562-2e22a5809ce1 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Going to run 1 instances... {{(pid=117125) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 04 19:07:40.618025 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-27e3ff74-4010-44aa-8562-2e22a5809ce1 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] [instance: 9d1266bd-77ec-4a0d-a557-71dafe7c5436] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2869595e-cda4-45af-aaeb-0779eb5f4114',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 04 19:07:40.662710 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-27e3ff74-4010-44aa-8562-2e22a5809ce1 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.728736 May 04 19:07:40.663324 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 95/199] 10.222.0.69 () {60 vars in 1146 bytes} [Wed May 4 19:07:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 04 19:07:40.674340 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-2e3175b7-26f6-4b5f-a37e-80418f31389d tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:40.674959 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-2e3175b7-26f6-4b5f-a37e-80418f31389d tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] [instance: 9d1266bd-77ec-4a0d-a557-71dafe7c5436] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:40.730238 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-2e3175b7-26f6-4b5f-a37e-80418f31389d tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632af5ddc209419a93461afdb070fc87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedb3ef21b1e413395b1a4cdcfb3f4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:40.739098 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-2e3175b7-26f6-4b5f-a37e-80418f31389d tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] 10.222.0.69 "GET /compute/v2.1/servers/9d1266bd-77ec-4a0d-a557-71dafe7c5436" status: 200 len: 1219 microversion: 2.1 time: 0.068690 May 04 19:07:40.739666 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 105/200] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:40 2022] GET /compute/v2.1/servers/9d1266bd-77ec-4a0d-a557-71dafe7c5436 => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:40.790313 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-6f7be826-2730-4ecd-bd3c-8bcc628e6673 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:40.790898 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-6f7be826-2730-4ecd-bd3c-8bcc628e6673 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 4b5bd528-4bc3-4bf3-be31-89364096663f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:40.797937 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6f7be826-2730-4ecd-bd3c-8bcc628e6673 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:40.798583 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6f7be826-2730-4ecd-bd3c-8bcc628e6673 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:40.799358 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6f7be826-2730-4ecd-bd3c-8bcc628e6673 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:40.799789 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6f7be826-2730-4ecd-bd3c-8bcc628e6673 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:40.936223 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-cbbe95a1-ba89-465a-8cbb-b3e60dc1d785 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:40.937714 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-cbbe95a1-ba89-465a-8cbb-b3e60dc1d785 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] [instance: 384b5f38-404a-478e-ba5e-af5e706841b3] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:40.944802 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-cbbe95a1-ba89-465a-8cbb-b3e60dc1d785 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:40.945597 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-cbbe95a1-ba89-465a-8cbb-b3e60dc1d785 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:40.946569 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-cbbe95a1-ba89-465a-8cbb-b3e60dc1d785 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:40.947155 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-cbbe95a1-ba89-465a-8cbb-b3e60dc1d785 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:41.106535 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-6f7be826-2730-4ecd-bd3c-8bcc628e6673 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:41.110274 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-cbbe95a1-ba89-465a-8cbb-b3e60dc1d785 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1298cdaba25f478a9ae358f87942ce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253bbd0defee4faf92eb8453dd4728fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:41.114042 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-6f7be826-2730-4ecd-bd3c-8bcc628e6673 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f" status: 200 len: 1520 microversion: 2.1 time: 0.328102 May 04 19:07:41.114760 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 96/201] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:40 2022] GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f => generated 1520 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:41.118755 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-cbbe95a1-ba89-465a-8cbb-b3e60dc1d785 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] 10.222.0.69 "GET /compute/v2.1/servers/384b5f38-404a-478e-ba5e-af5e706841b3" status: 200 len: 1313 microversion: 2.1 time: 0.192552 May 04 19:07:41.119438 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 106/202] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:40 2022] GET /compute/v2.1/servers/384b5f38-404a-478e-ba5e-af5e706841b3 => generated 1313 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:07:41.451686 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-cc7d5880-5c64-4237-8860-ed27d21c1b5b tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:41.452282 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-cc7d5880-5c64-4237-8860-ed27d21c1b5b tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: fae4a97e-a910-4f71-abf2-8f62425c6a52] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:41.458408 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cc7d5880-5c64-4237-8860-ed27d21c1b5b tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:41.458849 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cc7d5880-5c64-4237-8860-ed27d21c1b5b tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:41.459600 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cc7d5880-5c64-4237-8860-ed27d21c1b5b tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:41.460030 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cc7d5880-5c64-4237-8860-ed27d21c1b5b tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:41.596416 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-cc7d5880-5c64-4237-8860-ed27d21c1b5b tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:41.603647 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-cc7d5880-5c64-4237-8860-ed27d21c1b5b tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/fae4a97e-a910-4f71-abf2-8f62425c6a52" status: 200 len: 1367 microversion: 2.1 time: 0.155794 May 04 19:07:41.604216 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 97/203] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:41 2022] GET /compute/v2.1/servers/fae4a97e-a910-4f71-abf2-8f62425c6a52 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:41.755902 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-f3c13e70-7e6f-4e47-ae87-849ef3d3ba98 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:41.756503 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-f3c13e70-7e6f-4e47-ae87-849ef3d3ba98 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] [instance: 9d1266bd-77ec-4a0d-a557-71dafe7c5436] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:41.763385 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f3c13e70-7e6f-4e47-ae87-849ef3d3ba98 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:41.763821 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f3c13e70-7e6f-4e47-ae87-849ef3d3ba98 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:41.764577 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f3c13e70-7e6f-4e47-ae87-849ef3d3ba98 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:41.765215 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f3c13e70-7e6f-4e47-ae87-849ef3d3ba98 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:41.825486 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-f3c13e70-7e6f-4e47-ae87-849ef3d3ba98 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632af5ddc209419a93461afdb070fc87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedb3ef21b1e413395b1a4cdcfb3f4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:41.832833 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-f3c13e70-7e6f-4e47-ae87-849ef3d3ba98 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] 10.222.0.69 "GET /compute/v2.1/servers/9d1266bd-77ec-4a0d-a557-71dafe7c5436" status: 200 len: 1215 microversion: 2.1 time: 0.080707 May 04 19:07:41.833539 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 107/204] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:41 2022] GET /compute/v2.1/servers/9d1266bd-77ec-4a0d-a557-71dafe7c5436 => generated 1215 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:42.131248 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-f72458fb-24a6-44ec-b3cf-a53d95ddebe7 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:42.131881 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-f72458fb-24a6-44ec-b3cf-a53d95ddebe7 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 4b5bd528-4bc3-4bf3-be31-89364096663f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:42.135145 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-d438729a-e4db-4e17-9f9d-90539af16d13 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:42.135755 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-d438729a-e4db-4e17-9f9d-90539af16d13 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] [instance: 384b5f38-404a-478e-ba5e-af5e706841b3] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:42.137867 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f72458fb-24a6-44ec-b3cf-a53d95ddebe7 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:42.138316 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f72458fb-24a6-44ec-b3cf-a53d95ddebe7 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:42.139068 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f72458fb-24a6-44ec-b3cf-a53d95ddebe7 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:42.139500 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f72458fb-24a6-44ec-b3cf-a53d95ddebe7 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:42.141743 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d438729a-e4db-4e17-9f9d-90539af16d13 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:42.142447 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d438729a-e4db-4e17-9f9d-90539af16d13 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:42.143236 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d438729a-e4db-4e17-9f9d-90539af16d13 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:42.143669 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d438729a-e4db-4e17-9f9d-90539af16d13 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:42.267788 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-f72458fb-24a6-44ec-b3cf-a53d95ddebe7 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:42.272529 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-d438729a-e4db-4e17-9f9d-90539af16d13 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1298cdaba25f478a9ae358f87942ce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253bbd0defee4faf92eb8453dd4728fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:42.276623 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-f72458fb-24a6-44ec-b3cf-a53d95ddebe7 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f" status: 200 len: 1520 microversion: 2.1 time: 0.149230 May 04 19:07:42.277310 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 98/205] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:42 2022] GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:42.286291 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-d438729a-e4db-4e17-9f9d-90539af16d13 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] 10.222.0.69 "GET /compute/v2.1/servers/384b5f38-404a-478e-ba5e-af5e706841b3" status: 200 len: 1313 microversion: 2.1 time: 0.154782 May 04 19:07:42.287452 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 108/206] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:42 2022] GET /compute/v2.1/servers/384b5f38-404a-478e-ba5e-af5e706841b3 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:07:42.478262 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-fd95a729-ef4d-43b9-84f5-6f681db008c6 req-af75fcf3-775b-40e3-bbf7-6dc5fefaf455 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fae4a97e-a910-4f71-abf2-8f62425c6a52", "name": "network-vif-plugged", "status": "completed", "tag": "8a90cb33-99be-414d-99e2-31861f252bb4"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:07:42.487469 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-fd95a729-ef4d-43b9-84f5-6f681db008c6 req-af75fcf3-775b-40e3-bbf7-6dc5fefaf455 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:42.488058 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-fd95a729-ef4d-43b9-84f5-6f681db008c6 req-af75fcf3-775b-40e3-bbf7-6dc5fefaf455 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:42.500977 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-fd95a729-ef4d-43b9-84f5-6f681db008c6 req-af75fcf3-775b-40e3-bbf7-6dc5fefaf455 service nova] Creating event network-vif-plugged:8a90cb33-99be-414d-99e2-31861f252bb4 for instance fae4a97e-a910-4f71-abf2-8f62425c6a52 on hv-cinder-83090 May 04 19:07:42.506178 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-fd95a729-ef4d-43b9-84f5-6f681db008c6 req-af75fcf3-775b-40e3-bbf7-6dc5fefaf455 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032371 May 04 19:07:42.506848 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 99/207] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:07:42.621089 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-4df030ab-b031-41c6-86a1-6d28f71acd0e tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:42.621736 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-4df030ab-b031-41c6-86a1-6d28f71acd0e tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: fae4a97e-a910-4f71-abf2-8f62425c6a52] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:42.627694 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4df030ab-b031-41c6-86a1-6d28f71acd0e tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:42.628144 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4df030ab-b031-41c6-86a1-6d28f71acd0e tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:42.628899 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4df030ab-b031-41c6-86a1-6d28f71acd0e tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:42.629331 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4df030ab-b031-41c6-86a1-6d28f71acd0e tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:42.755760 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-4df030ab-b031-41c6-86a1-6d28f71acd0e tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:42.763665 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-4df030ab-b031-41c6-86a1-6d28f71acd0e tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/fae4a97e-a910-4f71-abf2-8f62425c6a52" status: 200 len: 1367 microversion: 2.1 time: 0.147427 May 04 19:07:42.764216 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 109/208] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:42 2022] GET /compute/v2.1/servers/fae4a97e-a910-4f71-abf2-8f62425c6a52 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:42.850325 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-d0959149-1263-4405-9a45-2a0e112c74a4 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:42.851130 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-d0959149-1263-4405-9a45-2a0e112c74a4 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] [instance: 9d1266bd-77ec-4a0d-a557-71dafe7c5436] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:42.858235 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d0959149-1263-4405-9a45-2a0e112c74a4 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:42.859252 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d0959149-1263-4405-9a45-2a0e112c74a4 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:42.860099 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d0959149-1263-4405-9a45-2a0e112c74a4 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:42.860660 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d0959149-1263-4405-9a45-2a0e112c74a4 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:42.926849 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-d0959149-1263-4405-9a45-2a0e112c74a4 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632af5ddc209419a93461afdb070fc87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedb3ef21b1e413395b1a4cdcfb3f4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:42.934750 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-d0959149-1263-4405-9a45-2a0e112c74a4 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] 10.222.0.69 "GET /compute/v2.1/servers/9d1266bd-77ec-4a0d-a557-71dafe7c5436" status: 200 len: 1279 microversion: 2.1 time: 0.089051 May 04 19:07:42.935626 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 100/209] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:42 2022] GET /compute/v2.1/servers/9d1266bd-77ec-4a0d-a557-71dafe7c5436 => generated 1279 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:43.294082 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-e0f92466-b7a4-4a51-a9aa-c0564d76ff2a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:43.294682 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-e0f92466-b7a4-4a51-a9aa-c0564d76ff2a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 4b5bd528-4bc3-4bf3-be31-89364096663f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:43.301367 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e0f92466-b7a4-4a51-a9aa-c0564d76ff2a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:43.302200 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e0f92466-b7a4-4a51-a9aa-c0564d76ff2a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:43.302929 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e0f92466-b7a4-4a51-a9aa-c0564d76ff2a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:43.303492 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e0f92466-b7a4-4a51-a9aa-c0564d76ff2a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:43.304155 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-b2b44f0b-23ed-4770-a4e6-7caa257e6e1d tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:43.305500 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-b2b44f0b-23ed-4770-a4e6-7caa257e6e1d tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] [instance: 384b5f38-404a-478e-ba5e-af5e706841b3] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:43.312889 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b2b44f0b-23ed-4770-a4e6-7caa257e6e1d tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:43.313336 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b2b44f0b-23ed-4770-a4e6-7caa257e6e1d tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:43.314136 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b2b44f0b-23ed-4770-a4e6-7caa257e6e1d tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:43.314596 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b2b44f0b-23ed-4770-a4e6-7caa257e6e1d tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:43.448294 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-b2b44f0b-23ed-4770-a4e6-7caa257e6e1d tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1298cdaba25f478a9ae358f87942ce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253bbd0defee4faf92eb8453dd4728fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:43.455890 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-b2b44f0b-23ed-4770-a4e6-7caa257e6e1d tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] 10.222.0.69 "GET /compute/v2.1/servers/384b5f38-404a-478e-ba5e-af5e706841b3" status: 200 len: 1313 microversion: 2.1 time: 0.155875 May 04 19:07:43.456556 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 101/210] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:43 2022] GET /compute/v2.1/servers/384b5f38-404a-478e-ba5e-af5e706841b3 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:43.482958 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-e0f92466-b7a4-4a51-a9aa-c0564d76ff2a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:43.490587 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-e0f92466-b7a4-4a51-a9aa-c0564d76ff2a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f" status: 200 len: 1520 microversion: 2.1 time: 0.200150 May 04 19:07:43.491153 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 110/211] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:43 2022] GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f => generated 1520 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:43.780482 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-3239712b-8cb1-4f7e-bad8-efd05fcdd5ed tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:43.781089 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-3239712b-8cb1-4f7e-bad8-efd05fcdd5ed tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: fae4a97e-a910-4f71-abf2-8f62425c6a52] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:43.786968 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3239712b-8cb1-4f7e-bad8-efd05fcdd5ed tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:43.787416 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3239712b-8cb1-4f7e-bad8-efd05fcdd5ed tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:43.788204 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3239712b-8cb1-4f7e-bad8-efd05fcdd5ed tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:43.788638 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3239712b-8cb1-4f7e-bad8-efd05fcdd5ed tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:43.914764 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-3239712b-8cb1-4f7e-bad8-efd05fcdd5ed tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:43.922035 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-3239712b-8cb1-4f7e-bad8-efd05fcdd5ed tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/fae4a97e-a910-4f71-abf2-8f62425c6a52" status: 200 len: 1367 microversion: 2.1 time: 0.145357 May 04 19:07:43.922633 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 102/212] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:43 2022] GET /compute/v2.1/servers/fae4a97e-a910-4f71-abf2-8f62425c6a52 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:43.952379 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-79f39542-a261-478f-a0c6-020382610c65 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:43.953019 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-79f39542-a261-478f-a0c6-020382610c65 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] [instance: 9d1266bd-77ec-4a0d-a557-71dafe7c5436] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:43.959538 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-79f39542-a261-478f-a0c6-020382610c65 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:43.959985 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-79f39542-a261-478f-a0c6-020382610c65 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:43.960756 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-79f39542-a261-478f-a0c6-020382610c65 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:43.961811 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-79f39542-a261-478f-a0c6-020382610c65 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:44.086735 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-79f39542-a261-478f-a0c6-020382610c65 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632af5ddc209419a93461afdb070fc87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedb3ef21b1e413395b1a4cdcfb3f4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:44.093895 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-79f39542-a261-478f-a0c6-020382610c65 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] 10.222.0.69 "GET /compute/v2.1/servers/9d1266bd-77ec-4a0d-a557-71dafe7c5436" status: 200 len: 1319 microversion: 2.1 time: 0.145327 May 04 19:07:44.094466 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 111/213] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:43 2022] GET /compute/v2.1/servers/9d1266bd-77ec-4a0d-a557-71dafe7c5436 => generated 1319 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:44.472173 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-8f5f6ed0-7618-42cb-8a64-1fced133f57f tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:44.472784 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-8f5f6ed0-7618-42cb-8a64-1fced133f57f tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] [instance: 384b5f38-404a-478e-ba5e-af5e706841b3] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:44.478711 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8f5f6ed0-7618-42cb-8a64-1fced133f57f tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:44.479349 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8f5f6ed0-7618-42cb-8a64-1fced133f57f tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:44.480110 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8f5f6ed0-7618-42cb-8a64-1fced133f57f tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:44.480697 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8f5f6ed0-7618-42cb-8a64-1fced133f57f tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:44.509722 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-8f1b6498-9178-42be-b3a6-458f198c4815 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:44.510342 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-8f1b6498-9178-42be-b3a6-458f198c4815 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 4b5bd528-4bc3-4bf3-be31-89364096663f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:44.518376 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8f1b6498-9178-42be-b3a6-458f198c4815 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:44.518815 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8f1b6498-9178-42be-b3a6-458f198c4815 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:44.519605 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8f1b6498-9178-42be-b3a6-458f198c4815 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:44.520011 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8f1b6498-9178-42be-b3a6-458f198c4815 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:44.673583 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-8f5f6ed0-7618-42cb-8a64-1fced133f57f tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1298cdaba25f478a9ae358f87942ce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253bbd0defee4faf92eb8453dd4728fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:44.684232 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-8f5f6ed0-7618-42cb-8a64-1fced133f57f tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] 10.222.0.69 "GET /compute/v2.1/servers/384b5f38-404a-478e-ba5e-af5e706841b3" status: 200 len: 1313 microversion: 2.1 time: 0.216015 May 04 19:07:44.689673 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 103/214] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:44 2022] GET /compute/v2.1/servers/384b5f38-404a-478e-ba5e-af5e706841b3 => generated 1313 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:44.914906 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-8f1b6498-9178-42be-b3a6-458f198c4815 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:44.922942 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-8f1b6498-9178-42be-b3a6-458f198c4815 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f" status: 200 len: 1520 microversion: 2.1 time: 0.417846 May 04 19:07:44.923729 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 112/215] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:44 2022] GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f => generated 1520 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:44.938818 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-261b7447-d618-4955-ab74-69312822347e tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:44.939422 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-261b7447-d618-4955-ab74-69312822347e tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: fae4a97e-a910-4f71-abf2-8f62425c6a52] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:44.945221 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-261b7447-d618-4955-ab74-69312822347e tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:44.946360 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-261b7447-d618-4955-ab74-69312822347e tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:44.947250 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-261b7447-d618-4955-ab74-69312822347e tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:44.947671 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-261b7447-d618-4955-ab74-69312822347e tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:45.054830 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-e1c48440-13e7-40b6-aff8-99a88261e9ee req-eeedc3d3-893b-4fff-8095-2e14a903fc89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d1266bd-77ec-4a0d-a557-71dafe7c5436", "tag": "cf5bc90a-dbe3-486e-b992-7836d9d6b2bb"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:07:45.063896 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-e1c48440-13e7-40b6-aff8-99a88261e9ee req-eeedc3d3-893b-4fff-8095-2e14a903fc89 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:45.064630 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-e1c48440-13e7-40b6-aff8-99a88261e9ee req-eeedc3d3-893b-4fff-8095-2e14a903fc89 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:45.077979 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-e1c48440-13e7-40b6-aff8-99a88261e9ee req-eeedc3d3-893b-4fff-8095-2e14a903fc89 service nova] Creating event network-changed:cf5bc90a-dbe3-486e-b992-7836d9d6b2bb for instance 9d1266bd-77ec-4a0d-a557-71dafe7c5436 on hv-cinder-83090 May 04 19:07:45.088158 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-e1c48440-13e7-40b6-aff8-99a88261e9ee req-eeedc3d3-893b-4fff-8095-2e14a903fc89 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036904 May 04 19:07:45.089228 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-261b7447-d618-4955-ab74-69312822347e tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:45.089404 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 113/216] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:07:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 04 19:07:45.097095 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-261b7447-d618-4955-ab74-69312822347e tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/fae4a97e-a910-4f71-abf2-8f62425c6a52" status: 200 len: 1557 microversion: 2.1 time: 0.162069 May 04 19:07:45.097690 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 104/217] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:44 2022] GET /compute/v2.1/servers/fae4a97e-a910-4f71-abf2-8f62425c6a52 => generated 1557 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:45.111366 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-ae5c1c1f-495e-4ab1-82a6-c1d7d26767b1 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:45.112087 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-ae5c1c1f-495e-4ab1-82a6-c1d7d26767b1 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] [instance: 9d1266bd-77ec-4a0d-a557-71dafe7c5436] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:45.113187 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-dd424d6d-e008-4048-a71b-8d172cc34e31 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:45.113814 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-dd424d6d-e008-4048-a71b-8d172cc34e31 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: fae4a97e-a910-4f71-abf2-8f62425c6a52] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:45.119009 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ae5c1c1f-495e-4ab1-82a6-c1d7d26767b1 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:45.120010 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ae5c1c1f-495e-4ab1-82a6-c1d7d26767b1 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:45.120573 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-dd424d6d-e008-4048-a71b-8d172cc34e31 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:45.120767 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ae5c1c1f-495e-4ab1-82a6-c1d7d26767b1 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:45.121213 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ae5c1c1f-495e-4ab1-82a6-c1d7d26767b1 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:45.121343 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-dd424d6d-e008-4048-a71b-8d172cc34e31 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:45.122303 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-dd424d6d-e008-4048-a71b-8d172cc34e31 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:45.122734 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-dd424d6d-e008-4048-a71b-8d172cc34e31 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:45.199572 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-dd424d6d-e008-4048-a71b-8d172cc34e31 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/fae4a97e-a910-4f71-abf2-8f62425c6a52/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090150 May 04 19:07:45.200599 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 105/218] 10.222.0.69 () {58 vars in 1274 bytes} [Wed May 4 19:07:45 2022] GET /compute/v2.1/servers/fae4a97e-a910-4f71-abf2-8f62425c6a52/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 04 19:07:45.253870 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-ae5c1c1f-495e-4ab1-82a6-c1d7d26767b1 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632af5ddc209419a93461afdb070fc87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedb3ef21b1e413395b1a4cdcfb3f4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:45.261777 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-ae5c1c1f-495e-4ab1-82a6-c1d7d26767b1 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] 10.222.0.69 "GET /compute/v2.1/servers/9d1266bd-77ec-4a0d-a557-71dafe7c5436" status: 200 len: 1319 microversion: 2.1 time: 0.155768 May 04 19:07:45.262345 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 114/219] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:45 2022] GET /compute/v2.1/servers/9d1266bd-77ec-4a0d-a557-71dafe7c5436 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:07:45.701802 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-ba9f6dc1-4ee5-4333-aeb3-baf0d394eef7 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:45.702461 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-ba9f6dc1-4ee5-4333-aeb3-baf0d394eef7 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] [instance: 384b5f38-404a-478e-ba5e-af5e706841b3] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:45.709066 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ba9f6dc1-4ee5-4333-aeb3-baf0d394eef7 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:45.709653 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ba9f6dc1-4ee5-4333-aeb3-baf0d394eef7 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:45.710511 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ba9f6dc1-4ee5-4333-aeb3-baf0d394eef7 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:45.711044 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ba9f6dc1-4ee5-4333-aeb3-baf0d394eef7 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:45.942322 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-e628f500-d1e8-4162-84b4-fc9d6a24c748 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:45.943065 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-e628f500-d1e8-4162-84b4-fc9d6a24c748 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 4b5bd528-4bc3-4bf3-be31-89364096663f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:45.950781 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e628f500-d1e8-4162-84b4-fc9d6a24c748 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:45.951361 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e628f500-d1e8-4162-84b4-fc9d6a24c748 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:45.952256 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e628f500-d1e8-4162-84b4-fc9d6a24c748 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:45.952765 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e628f500-d1e8-4162-84b4-fc9d6a24c748 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:46.116516 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-ba9f6dc1-4ee5-4333-aeb3-baf0d394eef7 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1298cdaba25f478a9ae358f87942ce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253bbd0defee4faf92eb8453dd4728fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:46.123974 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-ba9f6dc1-4ee5-4333-aeb3-baf0d394eef7 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] 10.222.0.69 "GET /compute/v2.1/servers/384b5f38-404a-478e-ba5e-af5e706841b3" status: 200 len: 1313 microversion: 2.1 time: 0.426354 May 04 19:07:46.124634 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 106/220] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:45 2022] GET /compute/v2.1/servers/384b5f38-404a-478e-ba5e-af5e706841b3 => generated 1313 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:46.179413 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-e628f500-d1e8-4162-84b4-fc9d6a24c748 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:46.188118 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-e628f500-d1e8-4162-84b4-fc9d6a24c748 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f" status: 200 len: 1520 microversion: 2.1 time: 0.250391 May 04 19:07:46.189106 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 115/221] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:45 2022] GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f => generated 1520 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:07:46.280123 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-9fbaf237-8ff6-4e54-bb61-789bee5161e3 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:46.280967 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-9fbaf237-8ff6-4e54-bb61-789bee5161e3 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] [instance: 9d1266bd-77ec-4a0d-a557-71dafe7c5436] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:46.287293 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9fbaf237-8ff6-4e54-bb61-789bee5161e3 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:46.287830 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9fbaf237-8ff6-4e54-bb61-789bee5161e3 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:46.288719 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9fbaf237-8ff6-4e54-bb61-789bee5161e3 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:46.289426 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9fbaf237-8ff6-4e54-bb61-789bee5161e3 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:46.491179 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-9fbaf237-8ff6-4e54-bb61-789bee5161e3 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632af5ddc209419a93461afdb070fc87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedb3ef21b1e413395b1a4cdcfb3f4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:46.499040 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-9fbaf237-8ff6-4e54-bb61-789bee5161e3 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] 10.222.0.69 "GET /compute/v2.1/servers/9d1266bd-77ec-4a0d-a557-71dafe7c5436" status: 200 len: 1319 microversion: 2.1 time: 0.223020 May 04 19:07:46.500136 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 107/222] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:46 2022] GET /compute/v2.1/servers/9d1266bd-77ec-4a0d-a557-71dafe7c5436 => generated 1319 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:46.646460 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-d24302b0-4d1d-4968-bdb8-86ccecbeef8a req-b24fe483-bbc3-42db-957d-94b107ec72dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "384b5f38-404a-478e-ba5e-af5e706841b3", "name": "network-vif-plugged", "status": "completed", "tag": "dac54407-f56f-4462-8538-3a40734619d0"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:07:46.660826 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-d24302b0-4d1d-4968-bdb8-86ccecbeef8a req-b24fe483-bbc3-42db-957d-94b107ec72dd service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:46.661292 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-d24302b0-4d1d-4968-bdb8-86ccecbeef8a req-b24fe483-bbc3-42db-957d-94b107ec72dd service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:46.672485 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-d24302b0-4d1d-4968-bdb8-86ccecbeef8a req-b24fe483-bbc3-42db-957d-94b107ec72dd service nova] Creating event network-vif-plugged:dac54407-f56f-4462-8538-3a40734619d0 for instance 384b5f38-404a-478e-ba5e-af5e706841b3 on hv-cinder-83090 May 04 19:07:46.677356 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-d24302b0-4d1d-4968-bdb8-86ccecbeef8a req-b24fe483-bbc3-42db-957d-94b107ec72dd service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035815 May 04 19:07:46.678182 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 116/223] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:07:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:07:46.760148 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-a4a65d8e-4e15-4f75-9b9f-7e09a7d612df req-b99a5402-a7d5-4fe0-ad16-0f2bfc982aee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fae4a97e-a910-4f71-abf2-8f62425c6a52", "tag": "8a90cb33-99be-414d-99e2-31861f252bb4"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:07:46.768950 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-a4a65d8e-4e15-4f75-9b9f-7e09a7d612df req-b99a5402-a7d5-4fe0-ad16-0f2bfc982aee service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:46.769395 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-a4a65d8e-4e15-4f75-9b9f-7e09a7d612df req-b99a5402-a7d5-4fe0-ad16-0f2bfc982aee service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:46.780353 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-a4a65d8e-4e15-4f75-9b9f-7e09a7d612df req-b99a5402-a7d5-4fe0-ad16-0f2bfc982aee service nova] Creating event network-changed:8a90cb33-99be-414d-99e2-31861f252bb4 for instance fae4a97e-a910-4f71-abf2-8f62425c6a52 on hv-cinder-83090 May 04 19:07:46.785362 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-a4a65d8e-4e15-4f75-9b9f-7e09a7d612df req-b99a5402-a7d5-4fe0-ad16-0f2bfc982aee service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029356 May 04 19:07:46.786309 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 108/224] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:07:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:07:47.142013 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-e169a5ae-317c-42ff-a270-b8b01fbac0a1 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:47.142964 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-e169a5ae-317c-42ff-a270-b8b01fbac0a1 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] [instance: 384b5f38-404a-478e-ba5e-af5e706841b3] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:47.148958 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e169a5ae-317c-42ff-a270-b8b01fbac0a1 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:47.149405 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e169a5ae-317c-42ff-a270-b8b01fbac0a1 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:47.150196 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e169a5ae-317c-42ff-a270-b8b01fbac0a1 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:47.150629 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e169a5ae-317c-42ff-a270-b8b01fbac0a1 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:47.206039 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-d7cffc46-0281-4c91-b91d-14b431297d79 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:47.206862 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-d7cffc46-0281-4c91-b91d-14b431297d79 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 4b5bd528-4bc3-4bf3-be31-89364096663f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:47.213373 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d7cffc46-0281-4c91-b91d-14b431297d79 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:47.214072 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d7cffc46-0281-4c91-b91d-14b431297d79 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:47.214942 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d7cffc46-0281-4c91-b91d-14b431297d79 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:47.215573 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d7cffc46-0281-4c91-b91d-14b431297d79 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:47.284999 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-e169a5ae-317c-42ff-a270-b8b01fbac0a1 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1298cdaba25f478a9ae358f87942ce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253bbd0defee4faf92eb8453dd4728fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:47.293088 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-e169a5ae-317c-42ff-a270-b8b01fbac0a1 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] 10.222.0.69 "GET /compute/v2.1/servers/384b5f38-404a-478e-ba5e-af5e706841b3" status: 200 len: 1313 microversion: 2.1 time: 0.155772 May 04 19:07:47.294132 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 117/225] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:47 2022] GET /compute/v2.1/servers/384b5f38-404a-478e-ba5e-af5e706841b3 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:47.347933 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-d7cffc46-0281-4c91-b91d-14b431297d79 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:47.355915 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-d7cffc46-0281-4c91-b91d-14b431297d79 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f" status: 200 len: 1520 microversion: 2.1 time: 0.154071 May 04 19:07:47.356497 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 109/226] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:47 2022] GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:07:47.516235 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-404d11c7-8073-4671-92ba-0251baf2d817 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:47.516843 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-404d11c7-8073-4671-92ba-0251baf2d817 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] [instance: 9d1266bd-77ec-4a0d-a557-71dafe7c5436] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:47.523903 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-404d11c7-8073-4671-92ba-0251baf2d817 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:47.524349 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-404d11c7-8073-4671-92ba-0251baf2d817 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:47.525102 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-404d11c7-8073-4671-92ba-0251baf2d817 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:47.525565 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-404d11c7-8073-4671-92ba-0251baf2d817 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:47.788723 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-404d11c7-8073-4671-92ba-0251baf2d817 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632af5ddc209419a93461afdb070fc87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedb3ef21b1e413395b1a4cdcfb3f4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:47.796468 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-404d11c7-8073-4671-92ba-0251baf2d817 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] 10.222.0.69 "GET /compute/v2.1/servers/9d1266bd-77ec-4a0d-a557-71dafe7c5436" status: 200 len: 1319 microversion: 2.1 time: 0.284138 May 04 19:07:47.797127 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 118/227] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:47 2022] GET /compute/v2.1/servers/9d1266bd-77ec-4a0d-a557-71dafe7c5436 => generated 1319 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:48.310441 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-ff775d93-59a1-4c97-80c5-1a4d496caac4 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:48.311043 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-ff775d93-59a1-4c97-80c5-1a4d496caac4 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] [instance: 384b5f38-404a-478e-ba5e-af5e706841b3] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:48.316884 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ff775d93-59a1-4c97-80c5-1a4d496caac4 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:48.317324 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ff775d93-59a1-4c97-80c5-1a4d496caac4 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:48.318102 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ff775d93-59a1-4c97-80c5-1a4d496caac4 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:48.318532 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ff775d93-59a1-4c97-80c5-1a4d496caac4 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:48.372620 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-7f192208-7e86-4d1e-81ce-d3463f1df1fb tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:48.373228 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-7f192208-7e86-4d1e-81ce-d3463f1df1fb tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 4b5bd528-4bc3-4bf3-be31-89364096663f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:48.379495 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7f192208-7e86-4d1e-81ce-d3463f1df1fb tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:48.379962 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7f192208-7e86-4d1e-81ce-d3463f1df1fb tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:48.380714 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7f192208-7e86-4d1e-81ce-d3463f1df1fb tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:48.381141 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7f192208-7e86-4d1e-81ce-d3463f1df1fb tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:48.449660 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-ff775d93-59a1-4c97-80c5-1a4d496caac4 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1298cdaba25f478a9ae358f87942ce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253bbd0defee4faf92eb8453dd4728fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:48.456889 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-ff775d93-59a1-4c97-80c5-1a4d496caac4 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] 10.222.0.69 "GET /compute/v2.1/servers/384b5f38-404a-478e-ba5e-af5e706841b3" status: 200 len: 1313 microversion: 2.1 time: 0.150323 May 04 19:07:48.457454 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 110/228] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:48 2022] GET /compute/v2.1/servers/384b5f38-404a-478e-ba5e-af5e706841b3 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:48.513500 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-7f192208-7e86-4d1e-81ce-d3463f1df1fb tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:48.520926 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-7f192208-7e86-4d1e-81ce-d3463f1df1fb tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f" status: 200 len: 1520 microversion: 2.1 time: 0.152188 May 04 19:07:48.521502 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 119/229] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:48 2022] GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:48.813135 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-f1c0312d-143a-43c4-8d78-1aaabcd94eed tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:48.813762 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-f1c0312d-143a-43c4-8d78-1aaabcd94eed tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] [instance: 9d1266bd-77ec-4a0d-a557-71dafe7c5436] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:48.819502 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f1c0312d-143a-43c4-8d78-1aaabcd94eed tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:48.819939 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f1c0312d-143a-43c4-8d78-1aaabcd94eed tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:48.820688 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f1c0312d-143a-43c4-8d78-1aaabcd94eed tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:48.821118 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f1c0312d-143a-43c4-8d78-1aaabcd94eed tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:48.952633 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-f1c0312d-143a-43c4-8d78-1aaabcd94eed tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632af5ddc209419a93461afdb070fc87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedb3ef21b1e413395b1a4cdcfb3f4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:48.959987 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-f1c0312d-143a-43c4-8d78-1aaabcd94eed tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] 10.222.0.69 "GET /compute/v2.1/servers/9d1266bd-77ec-4a0d-a557-71dafe7c5436" status: 200 len: 1319 microversion: 2.1 time: 0.150668 May 04 19:07:48.960549 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 111/230] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:48 2022] GET /compute/v2.1/servers/9d1266bd-77ec-4a0d-a557-71dafe7c5436 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:49.473567 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-8c259ec0-c7ca-468d-9870-f7a3cafa07bc tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:49.474169 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-8c259ec0-c7ca-468d-9870-f7a3cafa07bc tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] [instance: 384b5f38-404a-478e-ba5e-af5e706841b3] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:49.480525 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8c259ec0-c7ca-468d-9870-f7a3cafa07bc tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:49.480967 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8c259ec0-c7ca-468d-9870-f7a3cafa07bc tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:49.481748 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8c259ec0-c7ca-468d-9870-f7a3cafa07bc tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:49.482179 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8c259ec0-c7ca-468d-9870-f7a3cafa07bc tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:49.537878 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-c52f86f1-b6ab-4b02-b5e7-55d5034ddd17 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:49.538485 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-c52f86f1-b6ab-4b02-b5e7-55d5034ddd17 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 4b5bd528-4bc3-4bf3-be31-89364096663f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:49.544325 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c52f86f1-b6ab-4b02-b5e7-55d5034ddd17 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:49.544766 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c52f86f1-b6ab-4b02-b5e7-55d5034ddd17 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:49.545538 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c52f86f1-b6ab-4b02-b5e7-55d5034ddd17 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:49.545974 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c52f86f1-b6ab-4b02-b5e7-55d5034ddd17 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:49.610974 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-8c259ec0-c7ca-468d-9870-f7a3cafa07bc tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1298cdaba25f478a9ae358f87942ce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253bbd0defee4faf92eb8453dd4728fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:49.620994 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-8c259ec0-c7ca-468d-9870-f7a3cafa07bc tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] 10.222.0.69 "GET /compute/v2.1/servers/384b5f38-404a-478e-ba5e-af5e706841b3" status: 200 len: 1313 microversion: 2.1 time: 0.151299 May 04 19:07:49.621598 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 120/231] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:49 2022] GET /compute/v2.1/servers/384b5f38-404a-478e-ba5e-af5e706841b3 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:49.677834 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-c52f86f1-b6ab-4b02-b5e7-55d5034ddd17 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:49.685604 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-c52f86f1-b6ab-4b02-b5e7-55d5034ddd17 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f" status: 200 len: 1520 microversion: 2.1 time: 0.151535 May 04 19:07:49.686178 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 112/232] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:49 2022] GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:07:49.978350 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-9dd4ef22-5fc9-4b5f-a247-394568d3720c tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:49.978981 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-9dd4ef22-5fc9-4b5f-a247-394568d3720c tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] [instance: 9d1266bd-77ec-4a0d-a557-71dafe7c5436] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:49.984778 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9dd4ef22-5fc9-4b5f-a247-394568d3720c tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:49.985253 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9dd4ef22-5fc9-4b5f-a247-394568d3720c tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:49.986036 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9dd4ef22-5fc9-4b5f-a247-394568d3720c tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:49.986470 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9dd4ef22-5fc9-4b5f-a247-394568d3720c tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:50.111546 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-9dd4ef22-5fc9-4b5f-a247-394568d3720c tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632af5ddc209419a93461afdb070fc87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedb3ef21b1e413395b1a4cdcfb3f4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:50.119300 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-9dd4ef22-5fc9-4b5f-a247-394568d3720c tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] 10.222.0.69 "GET /compute/v2.1/servers/9d1266bd-77ec-4a0d-a557-71dafe7c5436" status: 200 len: 1319 microversion: 2.1 time: 0.145978 May 04 19:07:50.119873 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 121/233] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:49 2022] GET /compute/v2.1/servers/9d1266bd-77ec-4a0d-a557-71dafe7c5436 => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:50.637633 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-956e3da9-8169-48f8-8384-43f9a6ba466b tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:50.638249 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-956e3da9-8169-48f8-8384-43f9a6ba466b tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] [instance: 384b5f38-404a-478e-ba5e-af5e706841b3] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:50.644453 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-956e3da9-8169-48f8-8384-43f9a6ba466b tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:50.644900 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-956e3da9-8169-48f8-8384-43f9a6ba466b tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:50.645742 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-956e3da9-8169-48f8-8384-43f9a6ba466b tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:50.646181 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-956e3da9-8169-48f8-8384-43f9a6ba466b tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:50.703934 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-213ce218-d685-4148-b85e-f2cc1e813187 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:50.704564 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-213ce218-d685-4148-b85e-f2cc1e813187 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 4b5bd528-4bc3-4bf3-be31-89364096663f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:50.711515 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-213ce218-d685-4148-b85e-f2cc1e813187 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:50.711958 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-213ce218-d685-4148-b85e-f2cc1e813187 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:50.712740 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-213ce218-d685-4148-b85e-f2cc1e813187 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:50.713167 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-213ce218-d685-4148-b85e-f2cc1e813187 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:50.779390 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-956e3da9-8169-48f8-8384-43f9a6ba466b tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1298cdaba25f478a9ae358f87942ce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253bbd0defee4faf92eb8453dd4728fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:50.787410 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-956e3da9-8169-48f8-8384-43f9a6ba466b tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] 10.222.0.69 "GET /compute/v2.1/servers/384b5f38-404a-478e-ba5e-af5e706841b3" status: 200 len: 1498 microversion: 2.1 time: 0.153636 May 04 19:07:50.788231 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 113/234] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:50 2022] GET /compute/v2.1/servers/384b5f38-404a-478e-ba5e-af5e706841b3 => generated 1498 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:50.850199 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-213ce218-d685-4148-b85e-f2cc1e813187 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:50.859039 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-213ce218-d685-4148-b85e-f2cc1e813187 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f" status: 200 len: 1520 microversion: 2.1 time: 0.158999 May 04 19:07:50.859731 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 122/235] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:50 2022] GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:07:51.135859 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-04cb0106-ca3d-4f2a-976d-48644242d031 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:51.136607 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-04cb0106-ca3d-4f2a-976d-48644242d031 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] [instance: 9d1266bd-77ec-4a0d-a557-71dafe7c5436] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:51.142862 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-04cb0106-ca3d-4f2a-976d-48644242d031 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:51.143311 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-04cb0106-ca3d-4f2a-976d-48644242d031 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:51.144079 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-04cb0106-ca3d-4f2a-976d-48644242d031 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:51.144521 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-04cb0106-ca3d-4f2a-976d-48644242d031 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:51.269637 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-04cb0106-ca3d-4f2a-976d-48644242d031 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632af5ddc209419a93461afdb070fc87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedb3ef21b1e413395b1a4cdcfb3f4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:51.277045 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-04cb0106-ca3d-4f2a-976d-48644242d031 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] 10.222.0.69 "GET /compute/v2.1/servers/9d1266bd-77ec-4a0d-a557-71dafe7c5436" status: 200 len: 1319 microversion: 2.1 time: 0.145573 May 04 19:07:51.277664 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 114/236] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:51 2022] GET /compute/v2.1/servers/9d1266bd-77ec-4a0d-a557-71dafe7c5436 => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:51.356922 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-a637d699-b142-4885-964f-441ec4868bb9 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:51.357420 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-a637d699-b142-4885-964f-441ec4868bb9 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] [instance: 384b5f38-404a-478e-ba5e-af5e706841b3] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:51.363545 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a637d699-b142-4885-964f-441ec4868bb9 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:51.363977 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a637d699-b142-4885-964f-441ec4868bb9 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:51.364741 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a637d699-b142-4885-964f-441ec4868bb9 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:51.365176 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a637d699-b142-4885-964f-441ec4868bb9 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:51.390946 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-a637d699-b142-4885-964f-441ec4868bb9 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] [instance: 384b5f38-404a-478e-ba5e-af5e706841b3] Going to try to terminate instance {{(pid=117124) delete /opt/stack/nova/nova/compute/api.py:2664}} May 04 19:07:51.474377 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-a637d699-b142-4885-964f-441ec4868bb9 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] 10.222.0.69 "DELETE /compute/v2.1/servers/384b5f38-404a-478e-ba5e-af5e706841b3" status: 204 len: 0 microversion: 2.1 time: 0.121034 May 04 19:07:51.474982 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 123/237] 10.222.0.69 () {58 vars in 1238 bytes} [Wed May 4 19:07:51 2022] DELETE /compute/v2.1/servers/384b5f38-404a-478e-ba5e-af5e706841b3 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 04 19:07:51.483673 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-a30e537e-0162-4f37-862a-00d6168a8232 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:51.484281 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-a30e537e-0162-4f37-862a-00d6168a8232 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] [instance: 384b5f38-404a-478e-ba5e-af5e706841b3] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:51.490212 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a30e537e-0162-4f37-862a-00d6168a8232 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:51.490666 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a30e537e-0162-4f37-862a-00d6168a8232 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:51.491427 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a30e537e-0162-4f37-862a-00d6168a8232 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:51.491864 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a30e537e-0162-4f37-862a-00d6168a8232 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:51.620882 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-a30e537e-0162-4f37-862a-00d6168a8232 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1298cdaba25f478a9ae358f87942ce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253bbd0defee4faf92eb8453dd4728fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:51.628607 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-a30e537e-0162-4f37-862a-00d6168a8232 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] 10.222.0.69 "GET /compute/v2.1/servers/384b5f38-404a-478e-ba5e-af5e706841b3" status: 200 len: 1504 microversion: 2.1 time: 0.148707 May 04 19:07:51.629182 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 115/238] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:51 2022] GET /compute/v2.1/servers/384b5f38-404a-478e-ba5e-af5e706841b3 => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:51.876380 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-aedfea28-ab6a-4d57-9a35-b87d17ad1d83 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:51.877019 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-aedfea28-ab6a-4d57-9a35-b87d17ad1d83 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 4b5bd528-4bc3-4bf3-be31-89364096663f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:51.883838 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-aedfea28-ab6a-4d57-9a35-b87d17ad1d83 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:51.884280 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-aedfea28-ab6a-4d57-9a35-b87d17ad1d83 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:51.885033 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-aedfea28-ab6a-4d57-9a35-b87d17ad1d83 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:51.885485 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-aedfea28-ab6a-4d57-9a35-b87d17ad1d83 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:52.019870 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-aedfea28-ab6a-4d57-9a35-b87d17ad1d83 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:52.027660 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-aedfea28-ab6a-4d57-9a35-b87d17ad1d83 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f" status: 200 len: 1520 microversion: 2.1 time: 0.155584 May 04 19:07:52.028225 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 124/239] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:51 2022] GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:52.293739 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-b33080c5-80b4-4e05-9d92-596806cb810e tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:52.294373 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-b33080c5-80b4-4e05-9d92-596806cb810e tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] [instance: 9d1266bd-77ec-4a0d-a557-71dafe7c5436] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:52.300376 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b33080c5-80b4-4e05-9d92-596806cb810e tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:52.300835 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b33080c5-80b4-4e05-9d92-596806cb810e tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:52.301602 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b33080c5-80b4-4e05-9d92-596806cb810e tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:52.302037 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b33080c5-80b4-4e05-9d92-596806cb810e tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:52.430607 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-b33080c5-80b4-4e05-9d92-596806cb810e tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632af5ddc209419a93461afdb070fc87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedb3ef21b1e413395b1a4cdcfb3f4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:52.438542 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-b33080c5-80b4-4e05-9d92-596806cb810e tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] 10.222.0.69 "GET /compute/v2.1/servers/9d1266bd-77ec-4a0d-a557-71dafe7c5436" status: 200 len: 1319 microversion: 2.1 time: 0.148650 May 04 19:07:52.439111 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 116/240] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:52 2022] GET /compute/v2.1/servers/9d1266bd-77ec-4a0d-a557-71dafe7c5436 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:52.545710 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-f0b97851-70ce-49a0-ac2a-33d008bff7d9 req-28c0ccb1-daf6-425b-9a2a-5c403c64ec74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d1266bd-77ec-4a0d-a557-71dafe7c5436", "name": "network-vif-plugged", "status": "completed", "tag": "cf5bc90a-dbe3-486e-b992-7836d9d6b2bb"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:07:52.553733 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-f0b97851-70ce-49a0-ac2a-33d008bff7d9 req-28c0ccb1-daf6-425b-9a2a-5c403c64ec74 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:52.554198 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-f0b97851-70ce-49a0-ac2a-33d008bff7d9 req-28c0ccb1-daf6-425b-9a2a-5c403c64ec74 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:52.567261 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-f0b97851-70ce-49a0-ac2a-33d008bff7d9 req-28c0ccb1-daf6-425b-9a2a-5c403c64ec74 service nova] Creating event network-vif-plugged:cf5bc90a-dbe3-486e-b992-7836d9d6b2bb for instance 9d1266bd-77ec-4a0d-a557-71dafe7c5436 on hv-cinder-83090 May 04 19:07:52.574256 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-f0b97851-70ce-49a0-ac2a-33d008bff7d9 req-28c0ccb1-daf6-425b-9a2a-5c403c64ec74 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030880 May 04 19:07:52.574856 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 125/241] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:07:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:07:52.647867 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-858da033-a2d9-4c67-8b4b-094e89711c5a tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:52.648475 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-858da033-a2d9-4c67-8b4b-094e89711c5a tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] [instance: 384b5f38-404a-478e-ba5e-af5e706841b3] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:52.654859 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-858da033-a2d9-4c67-8b4b-094e89711c5a tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:52.655312 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-858da033-a2d9-4c67-8b4b-094e89711c5a tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:52.656073 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-858da033-a2d9-4c67-8b4b-094e89711c5a tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:52.656510 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-858da033-a2d9-4c67-8b4b-094e89711c5a tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:52.781855 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-858da033-a2d9-4c67-8b4b-094e89711c5a tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1298cdaba25f478a9ae358f87942ce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253bbd0defee4faf92eb8453dd4728fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:52.789264 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-858da033-a2d9-4c67-8b4b-094e89711c5a tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] 10.222.0.69 "GET /compute/v2.1/servers/384b5f38-404a-478e-ba5e-af5e706841b3" status: 200 len: 1504 microversion: 2.1 time: 0.145152 May 04 19:07:52.789851 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 117/242] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:52 2022] GET /compute/v2.1/servers/384b5f38-404a-478e-ba5e-af5e706841b3 => generated 1504 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:53.045683 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-3b95c153-b536-4d93-bccd-1a4672f61fef tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:53.046373 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-3b95c153-b536-4d93-bccd-1a4672f61fef tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 4b5bd528-4bc3-4bf3-be31-89364096663f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:53.052485 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3b95c153-b536-4d93-bccd-1a4672f61fef tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:53.052929 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3b95c153-b536-4d93-bccd-1a4672f61fef tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:53.053709 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3b95c153-b536-4d93-bccd-1a4672f61fef tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:53.054144 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3b95c153-b536-4d93-bccd-1a4672f61fef tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:53.183047 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-3b95c153-b536-4d93-bccd-1a4672f61fef tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:53.190415 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-3b95c153-b536-4d93-bccd-1a4672f61fef tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f" status: 200 len: 1520 microversion: 2.1 time: 0.149353 May 04 19:07:53.191008 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 126/243] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:53 2022] GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:53.456080 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-b8e04025-14a8-4eaf-892c-1fd191419a8b tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:53.456664 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-b8e04025-14a8-4eaf-892c-1fd191419a8b tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] [instance: 9d1266bd-77ec-4a0d-a557-71dafe7c5436] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:53.463219 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b8e04025-14a8-4eaf-892c-1fd191419a8b tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:53.463658 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b8e04025-14a8-4eaf-892c-1fd191419a8b tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:53.464415 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b8e04025-14a8-4eaf-892c-1fd191419a8b tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:53.464843 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b8e04025-14a8-4eaf-892c-1fd191419a8b tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:53.591891 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-b8e04025-14a8-4eaf-892c-1fd191419a8b tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632af5ddc209419a93461afdb070fc87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedb3ef21b1e413395b1a4cdcfb3f4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:53.599040 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-b8e04025-14a8-4eaf-892c-1fd191419a8b tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] 10.222.0.69 "GET /compute/v2.1/servers/9d1266bd-77ec-4a0d-a557-71dafe7c5436" status: 200 len: 1319 microversion: 2.1 time: 0.147238 May 04 19:07:53.599607 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 118/244] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:53 2022] GET /compute/v2.1/servers/9d1266bd-77ec-4a0d-a557-71dafe7c5436 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:53.805341 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-832e71cf-e048-4c60-9524-77d85d198a0d tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:53.806030 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-832e71cf-e048-4c60-9524-77d85d198a0d tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] [instance: 384b5f38-404a-478e-ba5e-af5e706841b3] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:53.812159 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-832e71cf-e048-4c60-9524-77d85d198a0d tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:53.812610 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-832e71cf-e048-4c60-9524-77d85d198a0d tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:53.813375 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-832e71cf-e048-4c60-9524-77d85d198a0d tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:53.813876 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-832e71cf-e048-4c60-9524-77d85d198a0d tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:53.938598 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-832e71cf-e048-4c60-9524-77d85d198a0d tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1298cdaba25f478a9ae358f87942ce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253bbd0defee4faf92eb8453dd4728fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:53.946680 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-832e71cf-e048-4c60-9524-77d85d198a0d tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] 10.222.0.69 "GET /compute/v2.1/servers/384b5f38-404a-478e-ba5e-af5e706841b3" status: 200 len: 1504 microversion: 2.1 time: 0.145312 May 04 19:07:53.947244 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 127/245] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:53 2022] GET /compute/v2.1/servers/384b5f38-404a-478e-ba5e-af5e706841b3 => generated 1504 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:54.206628 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-720cacda-135b-45a9-910e-a37f40ec5d78 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:54.207235 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-720cacda-135b-45a9-910e-a37f40ec5d78 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 4b5bd528-4bc3-4bf3-be31-89364096663f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:54.213102 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-720cacda-135b-45a9-910e-a37f40ec5d78 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:54.213583 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-720cacda-135b-45a9-910e-a37f40ec5d78 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:54.214406 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-720cacda-135b-45a9-910e-a37f40ec5d78 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:54.214779 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-720cacda-135b-45a9-910e-a37f40ec5d78 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:54.340472 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-720cacda-135b-45a9-910e-a37f40ec5d78 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:54.347719 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-720cacda-135b-45a9-910e-a37f40ec5d78 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f" status: 200 len: 1500 microversion: 2.1 time: 0.144962 May 04 19:07:54.348287 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 119/246] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:54 2022] GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f => generated 1500 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:54.363407 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-4e65a743-a00d-4a02-ba74-27dc7536d366 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:54.364011 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-4e65a743-a00d-4a02-ba74-27dc7536d366 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 150304bb-d8d1-4c08-93b6-fc07c69fd846] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:54.370691 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4e65a743-a00d-4a02-ba74-27dc7536d366 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:54.371135 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4e65a743-a00d-4a02-ba74-27dc7536d366 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:54.371886 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4e65a743-a00d-4a02-ba74-27dc7536d366 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:54.372320 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4e65a743-a00d-4a02-ba74-27dc7536d366 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:54.550461 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-4e65a743-a00d-4a02-ba74-27dc7536d366 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:54.558390 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-4e65a743-a00d-4a02-ba74-27dc7536d366 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846" status: 200 len: 1514 microversion: 2.1 time: 0.198769 May 04 19:07:54.558977 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 128/247] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:54 2022] GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846 => generated 1514 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:54.617752 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-f5d83944-c3e0-4c1f-9b5f-9fd365fcefdf tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:54.618528 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-f5d83944-c3e0-4c1f-9b5f-9fd365fcefdf tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] [instance: 9d1266bd-77ec-4a0d-a557-71dafe7c5436] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:54.626952 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f5d83944-c3e0-4c1f-9b5f-9fd365fcefdf tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:54.627608 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f5d83944-c3e0-4c1f-9b5f-9fd365fcefdf tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:54.628562 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f5d83944-c3e0-4c1f-9b5f-9fd365fcefdf tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:54.629142 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f5d83944-c3e0-4c1f-9b5f-9fd365fcefdf tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:54.776384 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-f5d83944-c3e0-4c1f-9b5f-9fd365fcefdf tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632af5ddc209419a93461afdb070fc87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedb3ef21b1e413395b1a4cdcfb3f4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:54.785885 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-f5d83944-c3e0-4c1f-9b5f-9fd365fcefdf tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] 10.222.0.69 "GET /compute/v2.1/servers/9d1266bd-77ec-4a0d-a557-71dafe7c5436" status: 200 len: 1319 microversion: 2.1 time: 0.172922 May 04 19:07:54.795625 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 120/248] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:54 2022] GET /compute/v2.1/servers/9d1266bd-77ec-4a0d-a557-71dafe7c5436 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:54.967177 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-c6e96006-9715-40dd-a18a-09de8214b9a0 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:54.967721 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-c6e96006-9715-40dd-a18a-09de8214b9a0 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] [instance: 384b5f38-404a-478e-ba5e-af5e706841b3] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:54.974195 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c6e96006-9715-40dd-a18a-09de8214b9a0 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:54.974648 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c6e96006-9715-40dd-a18a-09de8214b9a0 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:54.975431 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c6e96006-9715-40dd-a18a-09de8214b9a0 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:54.975937 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c6e96006-9715-40dd-a18a-09de8214b9a0 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:55.203673 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-c6e96006-9715-40dd-a18a-09de8214b9a0 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1298cdaba25f478a9ae358f87942ce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253bbd0defee4faf92eb8453dd4728fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:55.211539 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-c6e96006-9715-40dd-a18a-09de8214b9a0 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] 10.222.0.69 "GET /compute/v2.1/servers/384b5f38-404a-478e-ba5e-af5e706841b3" status: 200 len: 1504 microversion: 2.1 time: 0.252409 May 04 19:07:55.212115 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 129/249] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:54 2022] GET /compute/v2.1/servers/384b5f38-404a-478e-ba5e-af5e706841b3 => generated 1504 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:55.378671 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-abd9f985-ac37-454a-acf7-9fb14b4e3821 req-46cc8dab-16ec-495b-b9bd-267dfc5883fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "384b5f38-404a-478e-ba5e-af5e706841b3", "name": "network-vif-deleted", "tag": "dac54407-f56f-4462-8538-3a40734619d0"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:07:55.387761 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-abd9f985-ac37-454a-acf7-9fb14b4e3821 req-46cc8dab-16ec-495b-b9bd-267dfc5883fc service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:55.388272 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-abd9f985-ac37-454a-acf7-9fb14b4e3821 req-46cc8dab-16ec-495b-b9bd-267dfc5883fc service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:55.400530 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-abd9f985-ac37-454a-acf7-9fb14b4e3821 req-46cc8dab-16ec-495b-b9bd-267dfc5883fc service nova] Creating event network-vif-deleted:dac54407-f56f-4462-8538-3a40734619d0 for instance 384b5f38-404a-478e-ba5e-af5e706841b3 on hv-cinder-83090 May 04 19:07:55.405628 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-abd9f985-ac37-454a-acf7-9fb14b4e3821 req-46cc8dab-16ec-495b-b9bd-267dfc5883fc service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030585 May 04 19:07:55.406220 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 121/250] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:07:55.803195 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-99cc37d9-d986-45da-86ce-26ddde83eda0 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:55.803816 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-99cc37d9-d986-45da-86ce-26ddde83eda0 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] [instance: 9d1266bd-77ec-4a0d-a557-71dafe7c5436] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:55.810619 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-99cc37d9-d986-45da-86ce-26ddde83eda0 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:55.811067 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-99cc37d9-d986-45da-86ce-26ddde83eda0 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:55.811837 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-99cc37d9-d986-45da-86ce-26ddde83eda0 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:55.812266 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-99cc37d9-d986-45da-86ce-26ddde83eda0 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:55.939894 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-99cc37d9-d986-45da-86ce-26ddde83eda0 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632af5ddc209419a93461afdb070fc87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedb3ef21b1e413395b1a4cdcfb3f4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:55.946587 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-8062988e-7d26-4f2a-8399-8ffb476f1585 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:07:55.947679 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-8062988e-7d26-4f2a-8399-8ffb476f1585 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 150304bb-d8d1-4c08-93b6-fc07c69fd846] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:55.948185 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-99cc37d9-d986-45da-86ce-26ddde83eda0 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] 10.222.0.69 "GET /compute/v2.1/servers/9d1266bd-77ec-4a0d-a557-71dafe7c5436" status: 200 len: 1319 microversion: 2.1 time: 0.148784 May 04 19:07:55.948918 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 130/251] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:55 2022] GET /compute/v2.1/servers/9d1266bd-77ec-4a0d-a557-71dafe7c5436 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:55.953899 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8062988e-7d26-4f2a-8399-8ffb476f1585 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:55.954352 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8062988e-7d26-4f2a-8399-8ffb476f1585 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:55.955150 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8062988e-7d26-4f2a-8399-8ffb476f1585 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:55.955594 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8062988e-7d26-4f2a-8399-8ffb476f1585 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:55.978264 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.objects.instance [None req-8062988e-7d26-4f2a-8399-8ffb476f1585 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lazy-loading 'flavor' on Instance uuid 150304bb-d8d1-4c08-93b6-fc07c69fd846 {{(pid=117125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 04 19:07:56.047702 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-8062988e-7d26-4f2a-8399-8ffb476f1585 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "POST /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846/action" status: 200 len: 32 microversion: 2.1 time: 0.106100 May 04 19:07:56.048291 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 122/252] 10.222.0.69 () {60 vars in 1277 bytes} [Wed May 4 19:07:55 2022] POST /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846/action => generated 32 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 04 19:07:56.058254 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-ca80f68e-e102-420a-baa3-c02b642823fa tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:56.058811 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-ca80f68e-e102-420a-baa3-c02b642823fa tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 150304bb-d8d1-4c08-93b6-fc07c69fd846] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:56.064752 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ca80f68e-e102-420a-baa3-c02b642823fa tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:56.065206 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ca80f68e-e102-420a-baa3-c02b642823fa tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:56.066010 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ca80f68e-e102-420a-baa3-c02b642823fa tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:56.066460 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ca80f68e-e102-420a-baa3-c02b642823fa tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:56.193841 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-ca80f68e-e102-420a-baa3-c02b642823fa tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:56.201053 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-ca80f68e-e102-420a-baa3-c02b642823fa tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846" status: 200 len: 1520 microversion: 2.1 time: 0.147580 May 04 19:07:56.201850 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 131/253] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:56 2022] GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846 => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:07:56.229575 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-9c287096-84fd-43ed-a6b1-d4a255078bb9 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:56.230310 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-9c287096-84fd-43ed-a6b1-d4a255078bb9 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] [instance: 384b5f38-404a-478e-ba5e-af5e706841b3] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:56.236492 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9c287096-84fd-43ed-a6b1-d4a255078bb9 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:56.236942 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9c287096-84fd-43ed-a6b1-d4a255078bb9 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:56.237728 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9c287096-84fd-43ed-a6b1-d4a255078bb9 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:56.238169 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9c287096-84fd-43ed-a6b1-d4a255078bb9 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:56.270540 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9c287096-84fd-43ed-a6b1-d4a255078bb9 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:56.270984 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9c287096-84fd-43ed-a6b1-d4a255078bb9 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:56.271431 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.objects.instance [None req-9c287096-84fd-43ed-a6b1-d4a255078bb9 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lazy-loading 'fault' on Instance uuid 384b5f38-404a-478e-ba5e-af5e706841b3 {{(pid=117125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 04 19:07:56.317006 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-9c287096-84fd-43ed-a6b1-d4a255078bb9 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1298cdaba25f478a9ae358f87942ce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253bbd0defee4faf92eb8453dd4728fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:56.324386 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-9c287096-84fd-43ed-a6b1-d4a255078bb9 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] 10.222.0.69 "GET /compute/v2.1/servers/384b5f38-404a-478e-ba5e-af5e706841b3" status: 200 len: 1303 microversion: 2.1 time: 0.099849 May 04 19:07:56.324958 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 123/254] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:56 2022] GET /compute/v2.1/servers/384b5f38-404a-478e-ba5e-af5e706841b3 => generated 1303 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:56.969569 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-c293068f-951f-43e1-a913-a4d5f46fb703 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:56.977948 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-c293068f-951f-43e1-a913-a4d5f46fb703 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] [instance: 9d1266bd-77ec-4a0d-a557-71dafe7c5436] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:56.984213 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c293068f-951f-43e1-a913-a4d5f46fb703 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:56.984664 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c293068f-951f-43e1-a913-a4d5f46fb703 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:56.985441 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c293068f-951f-43e1-a913-a4d5f46fb703 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:56.985901 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c293068f-951f-43e1-a913-a4d5f46fb703 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:57.183027 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-c293068f-951f-43e1-a913-a4d5f46fb703 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632af5ddc209419a93461afdb070fc87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedb3ef21b1e413395b1a4cdcfb3f4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:57.190375 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-c293068f-951f-43e1-a913-a4d5f46fb703 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] 10.222.0.69 "GET /compute/v2.1/servers/9d1266bd-77ec-4a0d-a557-71dafe7c5436" status: 200 len: 1508 microversion: 2.1 time: 0.224665 May 04 19:07:57.190955 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 132/255] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:56 2022] GET /compute/v2.1/servers/9d1266bd-77ec-4a0d-a557-71dafe7c5436 => generated 1508 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:57.218143 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-1a035e54-01dc-47bf-8bc6-313bdc0727e8 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:57.218744 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-1a035e54-01dc-47bf-8bc6-313bdc0727e8 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 150304bb-d8d1-4c08-93b6-fc07c69fd846] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:57.226368 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1a035e54-01dc-47bf-8bc6-313bdc0727e8 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:57.226827 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1a035e54-01dc-47bf-8bc6-313bdc0727e8 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:57.227600 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1a035e54-01dc-47bf-8bc6-313bdc0727e8 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:57.228044 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1a035e54-01dc-47bf-8bc6-313bdc0727e8 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:57.341775 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-95ec246d-e2b9-4f6a-a143-272e92774581 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:57.342474 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-95ec246d-e2b9-4f6a-a143-272e92774581 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] [instance: 384b5f38-404a-478e-ba5e-af5e706841b3] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:57.348819 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-95ec246d-e2b9-4f6a-a143-272e92774581 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:57.349396 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-95ec246d-e2b9-4f6a-a143-272e92774581 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:57.350522 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-95ec246d-e2b9-4f6a-a143-272e92774581 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:57.350791 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-95ec246d-e2b9-4f6a-a143-272e92774581 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:57.365187 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.wsgi [None req-95ec246d-e2b9-4f6a-a143-272e92774581 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] HTTP exception thrown: Instance 384b5f38-404a-478e-ba5e-af5e706841b3 could not be found. May 04 19:07:57.365898 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-95ec246d-e2b9-4f6a-a143-272e92774581 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Returning 404 to user: Instance 384b5f38-404a-478e-ba5e-af5e706841b3 could not be found. {{(pid=117124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 04 19:07:57.366820 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-95ec246d-e2b9-4f6a-a143-272e92774581 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] 10.222.0.69 "GET /compute/v2.1/servers/384b5f38-404a-478e-ba5e-af5e706841b3" status: 404 len: 111 microversion: 2.1 time: 0.029306 May 04 19:07:57.377543 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 133/256] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:57 2022] GET /compute/v2.1/servers/384b5f38-404a-478e-ba5e-af5e706841b3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 04 19:07:57.377832 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-1a035e54-01dc-47bf-8bc6-313bdc0727e8 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:57.385209 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-1a035e54-01dc-47bf-8bc6-313bdc0727e8 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846" status: 200 len: 1520 microversion: 2.1 time: 0.170678 May 04 19:07:57.386346 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 124/257] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:57 2022] GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:57.474762 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-83abac51-1774-405b-9bb3-df956de71bf2 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1438382626", "imageRef": "2869595e-cda4-45af-aaeb-0779eb5f4114", "flavorRef": "452", "networks": [{"uuid": "214827e4-722a-43f1-9800-70bea389524e"}]}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:07:57.527639 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.network.neutron [None req-83abac51-1774-405b-9bb3-df956de71bf2 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] validate_networks() for [('214827e4-722a-43f1-9800-70bea389524e', None, None, None, None, None)] {{(pid=117124) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 04 19:07:57.877904 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-83abac51-1774-405b-9bb3-df956de71bf2 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Flavor limits 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 04 19:07:57.878398 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-83abac51-1774-405b-9bb3-df956de71bf2 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Image limits 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 04 19:07:57.878943 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-83abac51-1774-405b-9bb3-df956de71bf2 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Flavor pref 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 04 19:07:57.879576 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-83abac51-1774-405b-9bb3-df956de71bf2 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Image pref 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 04 19:07:57.880077 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-83abac51-1774-405b-9bb3-df956de71bf2 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 04 19:07:57.888595 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-83abac51-1774-405b-9bb3-df956de71bf2 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:57.889042 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-83abac51-1774-405b-9bb3-df956de71bf2 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:57.889869 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-83abac51-1774-405b-9bb3-df956de71bf2 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:57.890305 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-83abac51-1774-405b-9bb3-df956de71bf2 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:57.907834 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-83abac51-1774-405b-9bb3-df956de71bf2 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Getting quotas for project 253bbd0defee4faf92eb8453dd4728fa. Resources: {'cores', 'ram', 'instances'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 04 19:07:57.911946 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-83abac51-1774-405b-9bb3-df956de71bf2 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Getting quotas for user 1298cdaba25f478a9ae358f87942ce8b and project 253bbd0defee4faf92eb8453dd4728fa. Resources: {'cores', 'ram', 'instances'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 04 19:07:57.923482 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-83abac51-1774-405b-9bb3-df956de71bf2 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Going to run 1 instances... {{(pid=117124) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 04 19:07:57.925739 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-83abac51-1774-405b-9bb3-df956de71bf2 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] [instance: 43177d93-a222-45c3-ac47-9ca78417f7c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2869595e-cda4-45af-aaeb-0779eb5f4114',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 04 19:07:57.969331 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-83abac51-1774-405b-9bb3-df956de71bf2 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.498323 May 04 19:07:57.970013 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 134/258] 10.222.0.69 () {60 vars in 1146 bytes} [Wed May 4 19:07:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 500 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 04 19:07:57.980255 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-9f917899-aad2-4101-9965-d660e6a02b6c tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:57.980860 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-9f917899-aad2-4101-9965-d660e6a02b6c tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] [instance: 43177d93-a222-45c3-ac47-9ca78417f7c8] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:58.035241 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-9f917899-aad2-4101-9965-d660e6a02b6c tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1298cdaba25f478a9ae358f87942ce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253bbd0defee4faf92eb8453dd4728fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:58.045381 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-9f917899-aad2-4101-9965-d660e6a02b6c tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] 10.222.0.69 "GET /compute/v2.1/servers/43177d93-a222-45c3-ac47-9ca78417f7c8" status: 200 len: 1214 microversion: 2.1 time: 0.069363 May 04 19:07:58.046424 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 125/259] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:57 2022] GET /compute/v2.1/servers/43177d93-a222-45c3-ac47-9ca78417f7c8 => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:58.403920 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-13a79a1a-4ffa-43e8-b76d-5ebb707a79d2 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:58.404730 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-13a79a1a-4ffa-43e8-b76d-5ebb707a79d2 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 150304bb-d8d1-4c08-93b6-fc07c69fd846] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:58.410955 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-13a79a1a-4ffa-43e8-b76d-5ebb707a79d2 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:58.412039 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-13a79a1a-4ffa-43e8-b76d-5ebb707a79d2 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:58.412826 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-13a79a1a-4ffa-43e8-b76d-5ebb707a79d2 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:58.413273 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-13a79a1a-4ffa-43e8-b76d-5ebb707a79d2 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:58.564691 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-13a79a1a-4ffa-43e8-b76d-5ebb707a79d2 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:58.573430 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-13a79a1a-4ffa-43e8-b76d-5ebb707a79d2 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846" status: 200 len: 1520 microversion: 2.1 time: 0.174631 May 04 19:07:58.574028 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 135/260] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:58 2022] GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846 => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:58.588518 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-37244786-0151-4f7a-9edb-d5a568da86eb tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:58.589047 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-37244786-0151-4f7a-9edb-d5a568da86eb tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:58.594918 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-37244786-0151-4f7a-9edb-d5a568da86eb tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:58.595370 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-37244786-0151-4f7a-9edb-d5a568da86eb tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:58.596109 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-37244786-0151-4f7a-9edb-d5a568da86eb tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:58.596538 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-37244786-0151-4f7a-9edb-d5a568da86eb tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:58.619909 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-37244786-0151-4f7a-9edb-d5a568da86eb tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5/ips" status: 200 len: 153 microversion: 2.20 time: 0.035718 May 04 19:07:58.620555 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 126/261] 10.222.0.69 () {60 vars in 1288 bytes} [Wed May 4 19:07:58 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5/ips => generated 153 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 04 19:07:59.062986 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-b6468016-cd89-463c-9abb-30cfddb348e3 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:59.063591 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-b6468016-cd89-463c-9abb-30cfddb348e3 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] [instance: 43177d93-a222-45c3-ac47-9ca78417f7c8] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:59.070379 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b6468016-cd89-463c-9abb-30cfddb348e3 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:59.070834 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b6468016-cd89-463c-9abb-30cfddb348e3 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:59.071611 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b6468016-cd89-463c-9abb-30cfddb348e3 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:59.072053 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b6468016-cd89-463c-9abb-30cfddb348e3 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:59.141632 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-b6468016-cd89-463c-9abb-30cfddb348e3 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1298cdaba25f478a9ae358f87942ce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253bbd0defee4faf92eb8453dd4728fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:59.149416 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-b6468016-cd89-463c-9abb-30cfddb348e3 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] 10.222.0.69 "GET /compute/v2.1/servers/43177d93-a222-45c3-ac47-9ca78417f7c8" status: 200 len: 1274 microversion: 2.1 time: 0.090585 May 04 19:07:59.150272 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 136/262] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:59 2022] GET /compute/v2.1/servers/43177d93-a222-45c3-ac47-9ca78417f7c8 => generated 1274 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:07:59.590715 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-4d018c8a-af8d-41f9-8bb4-bf0d551607d0 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:07:59.591351 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-4d018c8a-af8d-41f9-8bb4-bf0d551607d0 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 150304bb-d8d1-4c08-93b6-fc07c69fd846] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:07:59.597171 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4d018c8a-af8d-41f9-8bb4-bf0d551607d0 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:59.597646 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4d018c8a-af8d-41f9-8bb4-bf0d551607d0 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:59.598410 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4d018c8a-af8d-41f9-8bb4-bf0d551607d0 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:07:59.598841 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4d018c8a-af8d-41f9-8bb4-bf0d551607d0 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:07:59.745964 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-4d018c8a-af8d-41f9-8bb4-bf0d551607d0 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:07:59.749946 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-4d018c8a-af8d-41f9-8bb4-bf0d551607d0 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846" status: 200 len: 1520 microversion: 2.1 time: 0.163441 May 04 19:07:59.751002 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 127/263] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:07:59 2022] GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:00.166978 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-1f7d6a4a-d76d-4a4d-a376-a8778fd09cf9 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:00.168301 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-1f7d6a4a-d76d-4a4d-a376-a8778fd09cf9 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] [instance: 43177d93-a222-45c3-ac47-9ca78417f7c8] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:00.175850 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1f7d6a4a-d76d-4a4d-a376-a8778fd09cf9 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:00.176523 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1f7d6a4a-d76d-4a4d-a376-a8778fd09cf9 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:00.177812 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1f7d6a4a-d76d-4a4d-a376-a8778fd09cf9 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:00.178490 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1f7d6a4a-d76d-4a4d-a376-a8778fd09cf9 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:00.410095 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-1f7d6a4a-d76d-4a4d-a376-a8778fd09cf9 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1298cdaba25f478a9ae358f87942ce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253bbd0defee4faf92eb8453dd4728fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:00.417556 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-1f7d6a4a-d76d-4a4d-a376-a8778fd09cf9 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] 10.222.0.69 "GET /compute/v2.1/servers/43177d93-a222-45c3-ac47-9ca78417f7c8" status: 200 len: 1314 microversion: 2.1 time: 0.254541 May 04 19:08:00.418091 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 137/264] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:00 2022] GET /compute/v2.1/servers/43177d93-a222-45c3-ac47-9ca78417f7c8 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:08:00.539875 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-0bad43a1-94f6-4197-9ae6-6d1804124168 req-2fa8ecac-bc74-40bd-87ea-a6a5eb70f0f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43177d93-a222-45c3-ac47-9ca78417f7c8", "tag": "413f0c9f-3f58-4dfd-996c-fa7d7b423966"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:08:00.548492 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-0bad43a1-94f6-4197-9ae6-6d1804124168 req-2fa8ecac-bc74-40bd-87ea-a6a5eb70f0f1 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:00.549002 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-0bad43a1-94f6-4197-9ae6-6d1804124168 req-2fa8ecac-bc74-40bd-87ea-a6a5eb70f0f1 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:00.562462 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-0bad43a1-94f6-4197-9ae6-6d1804124168 req-2fa8ecac-bc74-40bd-87ea-a6a5eb70f0f1 service nova] Creating event network-changed:413f0c9f-3f58-4dfd-996c-fa7d7b423966 for instance 43177d93-a222-45c3-ac47-9ca78417f7c8 on hv-cinder-83090 May 04 19:08:00.566991 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-0bad43a1-94f6-4197-9ae6-6d1804124168 req-2fa8ecac-bc74-40bd-87ea-a6a5eb70f0f1 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031350 May 04 19:08:00.567582 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 128/265] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:08:00.769113 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-1b96dd8a-cb79-41a5-b637-6f6a40981687 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:00.770084 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-1b96dd8a-cb79-41a5-b637-6f6a40981687 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 150304bb-d8d1-4c08-93b6-fc07c69fd846] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:00.777066 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1b96dd8a-cb79-41a5-b637-6f6a40981687 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:00.777752 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1b96dd8a-cb79-41a5-b637-6f6a40981687 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:00.778601 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1b96dd8a-cb79-41a5-b637-6f6a40981687 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:00.779079 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1b96dd8a-cb79-41a5-b637-6f6a40981687 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:00.992314 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-1b96dd8a-cb79-41a5-b637-6f6a40981687 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:00.999744 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-1b96dd8a-cb79-41a5-b637-6f6a40981687 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846" status: 200 len: 1520 microversion: 2.1 time: 0.235967 May 04 19:08:01.000315 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 138/266] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:00 2022] GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846 => generated 1520 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:01.165160 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-d693080a-521a-4e97-be0b-f7cd06a6da44 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:08:01.165882 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-d693080a-521a-4e97-be0b-f7cd06a6da44 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:01.172020 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d693080a-521a-4e97-be0b-f7cd06a6da44 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:01.172462 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d693080a-521a-4e97-be0b-f7cd06a6da44 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:01.173208 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d693080a-521a-4e97-be0b-f7cd06a6da44 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:01.173678 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d693080a-521a-4e97-be0b-f7cd06a6da44 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:01.197641 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.objects.instance [None req-d693080a-521a-4e97-be0b-f7cd06a6da44 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lazy-loading 'flavor' on Instance uuid 8f929e9e-51bf-477a-877b-6c162202c7f5 {{(pid=117125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 04 19:08:01.434282 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-487dfb7a-d4e5-4d91-a30d-b70ec10e6e0d tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:01.434896 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-487dfb7a-d4e5-4d91-a30d-b70ec10e6e0d tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] [instance: 43177d93-a222-45c3-ac47-9ca78417f7c8] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:01.441126 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-487dfb7a-d4e5-4d91-a30d-b70ec10e6e0d tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:01.441615 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-487dfb7a-d4e5-4d91-a30d-b70ec10e6e0d tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:01.442432 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-487dfb7a-d4e5-4d91-a30d-b70ec10e6e0d tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:01.442879 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-487dfb7a-d4e5-4d91-a30d-b70ec10e6e0d tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:01.475721 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-d693080a-521a-4e97-be0b-f7cd06a6da44 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "POST /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5/action" status: 202 len: 0 microversion: 2.20 time: 0.315335 May 04 19:08:01.479448 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 129/267] 10.222.0.69 () {62 vars in 1318 bytes} [Wed May 4 19:08:01 2022] POST /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5/action => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 04 19:08:01.484597 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-ce313c0a-ac59-4fd7-9b5c-530af3aa7249 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:01.485288 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-ce313c0a-ac59-4fd7-9b5c-530af3aa7249 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:01.491360 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ce313c0a-ac59-4fd7-9b5c-530af3aa7249 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:01.491802 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ce313c0a-ac59-4fd7-9b5c-530af3aa7249 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:01.492602 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ce313c0a-ac59-4fd7-9b5c-530af3aa7249 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:01.493030 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ce313c0a-ac59-4fd7-9b5c-530af3aa7249 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:01.575310 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-487dfb7a-d4e5-4d91-a30d-b70ec10e6e0d tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1298cdaba25f478a9ae358f87942ce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253bbd0defee4faf92eb8453dd4728fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:01.582624 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-487dfb7a-d4e5-4d91-a30d-b70ec10e6e0d tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] 10.222.0.69 "GET /compute/v2.1/servers/43177d93-a222-45c3-ac47-9ca78417f7c8" status: 200 len: 1314 microversion: 2.1 time: 0.152373 May 04 19:08:01.583201 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 139/268] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:01 2022] GET /compute/v2.1/servers/43177d93-a222-45c3-ac47-9ca78417f7c8 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:08:01.630200 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-ce313c0a-ac59-4fd7-9b5c-530af3aa7249 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:01.638420 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-ce313c0a-ac59-4fd7-9b5c-530af3aa7249 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:01.639907 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-ce313c0a-ac59-4fd7-9b5c-530af3aa7249 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:01.641049 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-ce313c0a-ac59-4fd7-9b5c-530af3aa7249 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1724 microversion: 2.20 time: 0.160383 May 04 19:08:01.641677 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 130/269] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:08:01 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 04 19:08:02.016737 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-60298579-4ca1-4d62-8127-245b511054a9 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:02.017632 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-60298579-4ca1-4d62-8127-245b511054a9 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 150304bb-d8d1-4c08-93b6-fc07c69fd846] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:02.023608 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-60298579-4ca1-4d62-8127-245b511054a9 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:02.024055 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-60298579-4ca1-4d62-8127-245b511054a9 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:02.024817 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-60298579-4ca1-4d62-8127-245b511054a9 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:02.025290 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-60298579-4ca1-4d62-8127-245b511054a9 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:02.151090 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-60298579-4ca1-4d62-8127-245b511054a9 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:02.158290 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-60298579-4ca1-4d62-8127-245b511054a9 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846" status: 200 len: 1520 microversion: 2.1 time: 0.145440 May 04 19:08:02.158854 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 140/270] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:02 2022] GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846 => generated 1520 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:02.602443 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-9d405712-05d3-485c-88ce-966471b1077a tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:02.603112 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-9d405712-05d3-485c-88ce-966471b1077a tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] [instance: 43177d93-a222-45c3-ac47-9ca78417f7c8] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:02.609170 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9d405712-05d3-485c-88ce-966471b1077a tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:02.609651 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9d405712-05d3-485c-88ce-966471b1077a tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:02.610416 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9d405712-05d3-485c-88ce-966471b1077a tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:02.610875 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9d405712-05d3-485c-88ce-966471b1077a tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:02.658755 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-03e4567a-f5e8-4ca2-935e-187f459e1f30 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:02.659371 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-03e4567a-f5e8-4ca2-935e-187f459e1f30 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:02.666356 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-03e4567a-f5e8-4ca2-935e-187f459e1f30 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:02.666802 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-03e4567a-f5e8-4ca2-935e-187f459e1f30 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:02.667591 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-03e4567a-f5e8-4ca2-935e-187f459e1f30 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:02.668023 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-03e4567a-f5e8-4ca2-935e-187f459e1f30 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:02.894225 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-03e4567a-f5e8-4ca2-935e-187f459e1f30 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:02.903143 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-03e4567a-f5e8-4ca2-935e-187f459e1f30 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:02.904622 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-03e4567a-f5e8-4ca2-935e-187f459e1f30 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:02.906114 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-03e4567a-f5e8-4ca2-935e-187f459e1f30 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1724 microversion: 2.20 time: 0.251213 May 04 19:08:02.906673 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 141/271] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:08:02 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1724 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 04 19:08:02.940031 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-9d405712-05d3-485c-88ce-966471b1077a tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1298cdaba25f478a9ae358f87942ce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253bbd0defee4faf92eb8453dd4728fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:02.948486 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-9d405712-05d3-485c-88ce-966471b1077a tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] 10.222.0.69 "GET /compute/v2.1/servers/43177d93-a222-45c3-ac47-9ca78417f7c8" status: 200 len: 1314 microversion: 2.1 time: 0.351742 May 04 19:08:02.949958 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 131/272] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:02 2022] GET /compute/v2.1/servers/43177d93-a222-45c3-ac47-9ca78417f7c8 => generated 1314 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:03.175948 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-61f68b50-07fe-4b84-9f36-e5f224e8db4b tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:03.176555 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-61f68b50-07fe-4b84-9f36-e5f224e8db4b tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 150304bb-d8d1-4c08-93b6-fc07c69fd846] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:03.183063 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-61f68b50-07fe-4b84-9f36-e5f224e8db4b tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:03.183506 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-61f68b50-07fe-4b84-9f36-e5f224e8db4b tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:03.184267 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-61f68b50-07fe-4b84-9f36-e5f224e8db4b tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:03.184697 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-61f68b50-07fe-4b84-9f36-e5f224e8db4b tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:03.332512 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-61f68b50-07fe-4b84-9f36-e5f224e8db4b tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:03.339756 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-61f68b50-07fe-4b84-9f36-e5f224e8db4b tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846" status: 200 len: 1520 microversion: 2.1 time: 0.167754 May 04 19:08:03.340319 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 142/273] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:03 2022] GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:03.924004 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-3c756796-59dc-46c6-b5a3-ba07c5a400d5 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:03.924602 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-3c756796-59dc-46c6-b5a3-ba07c5a400d5 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:03.930510 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3c756796-59dc-46c6-b5a3-ba07c5a400d5 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:03.930953 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3c756796-59dc-46c6-b5a3-ba07c5a400d5 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:03.931705 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3c756796-59dc-46c6-b5a3-ba07c5a400d5 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:03.932136 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3c756796-59dc-46c6-b5a3-ba07c5a400d5 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:03.968764 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-2a078dcc-4ec7-4e36-aa3e-14c041ae37cf tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:03.969389 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-2a078dcc-4ec7-4e36-aa3e-14c041ae37cf tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] [instance: 43177d93-a222-45c3-ac47-9ca78417f7c8] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:03.975963 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2a078dcc-4ec7-4e36-aa3e-14c041ae37cf tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:03.976411 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2a078dcc-4ec7-4e36-aa3e-14c041ae37cf tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:03.977792 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2a078dcc-4ec7-4e36-aa3e-14c041ae37cf tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:03.978228 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2a078dcc-4ec7-4e36-aa3e-14c041ae37cf tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:04.062905 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-3c756796-59dc-46c6-b5a3-ba07c5a400d5 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:04.070995 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-3c756796-59dc-46c6-b5a3-ba07c5a400d5 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:04.072511 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-3c756796-59dc-46c6-b5a3-ba07c5a400d5 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:04.073727 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-3c756796-59dc-46c6-b5a3-ba07c5a400d5 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1724 microversion: 2.20 time: 0.153637 May 04 19:08:04.074302 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 132/274] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:08:03 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:08:04.108894 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-2a078dcc-4ec7-4e36-aa3e-14c041ae37cf tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1298cdaba25f478a9ae358f87942ce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253bbd0defee4faf92eb8453dd4728fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:04.116223 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-2a078dcc-4ec7-4e36-aa3e-14c041ae37cf tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] 10.222.0.69 "GET /compute/v2.1/servers/43177d93-a222-45c3-ac47-9ca78417f7c8" status: 200 len: 1314 microversion: 2.1 time: 0.153075 May 04 19:08:04.116788 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 143/275] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:03 2022] GET /compute/v2.1/servers/43177d93-a222-45c3-ac47-9ca78417f7c8 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:08:04.356706 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-59a535d0-d158-424f-9273-a5de38a16aac tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:04.357434 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-59a535d0-d158-424f-9273-a5de38a16aac tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 150304bb-d8d1-4c08-93b6-fc07c69fd846] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:04.363439 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-59a535d0-d158-424f-9273-a5de38a16aac tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:04.363887 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-59a535d0-d158-424f-9273-a5de38a16aac tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:04.364640 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-59a535d0-d158-424f-9273-a5de38a16aac tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:04.365074 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-59a535d0-d158-424f-9273-a5de38a16aac tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:04.498244 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-59a535d0-d158-424f-9273-a5de38a16aac tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:04.505815 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-59a535d0-d158-424f-9273-a5de38a16aac tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846" status: 200 len: 1520 microversion: 2.1 time: 0.152869 May 04 19:08:04.506387 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 133/276] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:04 2022] GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:05.092122 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-fa245eda-9aad-4388-b21d-3d34baf2f5fa tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:05.092721 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-fa245eda-9aad-4388-b21d-3d34baf2f5fa tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:05.099049 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fa245eda-9aad-4388-b21d-3d34baf2f5fa tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:05.099490 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fa245eda-9aad-4388-b21d-3d34baf2f5fa tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:05.100252 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fa245eda-9aad-4388-b21d-3d34baf2f5fa tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:05.100686 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fa245eda-9aad-4388-b21d-3d34baf2f5fa tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:05.132234 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-4e4c92be-641b-44f5-a6c9-2bf27f515786 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:05.132856 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-4e4c92be-641b-44f5-a6c9-2bf27f515786 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] [instance: 43177d93-a222-45c3-ac47-9ca78417f7c8] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:05.138993 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4e4c92be-641b-44f5-a6c9-2bf27f515786 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:05.139443 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4e4c92be-641b-44f5-a6c9-2bf27f515786 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:05.140211 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4e4c92be-641b-44f5-a6c9-2bf27f515786 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:05.140644 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4e4c92be-641b-44f5-a6c9-2bf27f515786 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:05.233820 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-fa245eda-9aad-4388-b21d-3d34baf2f5fa tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:05.242116 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-fa245eda-9aad-4388-b21d-3d34baf2f5fa tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:05.242116 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-fa245eda-9aad-4388-b21d-3d34baf2f5fa tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:05.245812 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-fa245eda-9aad-4388-b21d-3d34baf2f5fa tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1724 microversion: 2.20 time: 0.157602 May 04 19:08:05.246461 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 144/277] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:08:05 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:08:05.277047 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-4e4c92be-641b-44f5-a6c9-2bf27f515786 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1298cdaba25f478a9ae358f87942ce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253bbd0defee4faf92eb8453dd4728fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:05.284193 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-4e4c92be-641b-44f5-a6c9-2bf27f515786 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] 10.222.0.69 "GET /compute/v2.1/servers/43177d93-a222-45c3-ac47-9ca78417f7c8" status: 200 len: 1314 microversion: 2.1 time: 0.155993 May 04 19:08:05.284756 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 134/278] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:05 2022] GET /compute/v2.1/servers/43177d93-a222-45c3-ac47-9ca78417f7c8 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:08:05.524589 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-3613de61-1cb8-4a6c-9c9b-4a145bf6bc8c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:05.525125 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-3613de61-1cb8-4a6c-9c9b-4a145bf6bc8c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 150304bb-d8d1-4c08-93b6-fc07c69fd846] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:05.531501 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3613de61-1cb8-4a6c-9c9b-4a145bf6bc8c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:05.531952 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3613de61-1cb8-4a6c-9c9b-4a145bf6bc8c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:05.532729 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3613de61-1cb8-4a6c-9c9b-4a145bf6bc8c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:05.533196 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3613de61-1cb8-4a6c-9c9b-4a145bf6bc8c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:05.656073 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-3613de61-1cb8-4a6c-9c9b-4a145bf6bc8c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:05.663254 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-3613de61-1cb8-4a6c-9c9b-4a145bf6bc8c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846" status: 200 len: 1520 microversion: 2.1 time: 0.143355 May 04 19:08:05.663823 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 145/279] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:05 2022] GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846 => generated 1520 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:06.263833 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-1e509d7e-f0b3-4a03-b301-dc04a7b12211 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:06.264388 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-1e509d7e-f0b3-4a03-b301-dc04a7b12211 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:06.270676 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1e509d7e-f0b3-4a03-b301-dc04a7b12211 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:06.271127 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1e509d7e-f0b3-4a03-b301-dc04a7b12211 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:06.271888 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1e509d7e-f0b3-4a03-b301-dc04a7b12211 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:06.272326 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1e509d7e-f0b3-4a03-b301-dc04a7b12211 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:06.300837 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-93505fff-7e48-48b9-9a3b-742d153fea22 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:06.301494 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-93505fff-7e48-48b9-9a3b-742d153fea22 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] [instance: 43177d93-a222-45c3-ac47-9ca78417f7c8] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:06.308322 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-93505fff-7e48-48b9-9a3b-742d153fea22 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:06.308765 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-93505fff-7e48-48b9-9a3b-742d153fea22 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:06.309546 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-93505fff-7e48-48b9-9a3b-742d153fea22 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:06.309975 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-93505fff-7e48-48b9-9a3b-742d153fea22 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:06.410338 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-1e509d7e-f0b3-4a03-b301-dc04a7b12211 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:06.418056 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-1e509d7e-f0b3-4a03-b301-dc04a7b12211 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:06.419565 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-1e509d7e-f0b3-4a03-b301-dc04a7b12211 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:06.420843 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-1e509d7e-f0b3-4a03-b301-dc04a7b12211 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1724 microversion: 2.20 time: 0.161058 May 04 19:08:06.421528 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 135/280] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:08:06 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:08:06.443551 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-93505fff-7e48-48b9-9a3b-742d153fea22 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1298cdaba25f478a9ae358f87942ce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253bbd0defee4faf92eb8453dd4728fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:06.451269 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-93505fff-7e48-48b9-9a3b-742d153fea22 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] 10.222.0.69 "GET /compute/v2.1/servers/43177d93-a222-45c3-ac47-9ca78417f7c8" status: 200 len: 1314 microversion: 2.1 time: 0.154272 May 04 19:08:06.451829 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 146/281] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:06 2022] GET /compute/v2.1/servers/43177d93-a222-45c3-ac47-9ca78417f7c8 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:08:06.644421 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-c1680d09-c2a6-427f-829c-dbcf5e9a0ca5 req-f231fd30-f2cd-42e9-885b-a8d833ca341c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43177d93-a222-45c3-ac47-9ca78417f7c8", "name": "network-vif-plugged", "status": "completed", "tag": "413f0c9f-3f58-4dfd-996c-fa7d7b423966"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:08:06.652443 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-c1680d09-c2a6-427f-829c-dbcf5e9a0ca5 req-f231fd30-f2cd-42e9-885b-a8d833ca341c service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:06.652880 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-c1680d09-c2a6-427f-829c-dbcf5e9a0ca5 req-f231fd30-f2cd-42e9-885b-a8d833ca341c service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:06.664539 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-c1680d09-c2a6-427f-829c-dbcf5e9a0ca5 req-f231fd30-f2cd-42e9-885b-a8d833ca341c service nova] Creating event network-vif-plugged:413f0c9f-3f58-4dfd-996c-fa7d7b423966 for instance 43177d93-a222-45c3-ac47-9ca78417f7c8 on hv-cinder-83090 May 04 19:08:06.669658 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-c1680d09-c2a6-427f-829c-dbcf5e9a0ca5 req-f231fd30-f2cd-42e9-885b-a8d833ca341c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029118 May 04 19:08:06.670559 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 136/282] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:08:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:08:06.680889 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-32c445e4-2af8-4566-8bd9-ebc580fc7713 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:06.682016 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-32c445e4-2af8-4566-8bd9-ebc580fc7713 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 150304bb-d8d1-4c08-93b6-fc07c69fd846] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:06.688242 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-32c445e4-2af8-4566-8bd9-ebc580fc7713 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:06.688686 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-32c445e4-2af8-4566-8bd9-ebc580fc7713 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:06.689480 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-32c445e4-2af8-4566-8bd9-ebc580fc7713 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:06.689926 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-32c445e4-2af8-4566-8bd9-ebc580fc7713 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:06.818146 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-32c445e4-2af8-4566-8bd9-ebc580fc7713 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:06.825534 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-32c445e4-2af8-4566-8bd9-ebc580fc7713 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846" status: 200 len: 1520 microversion: 2.1 time: 0.149240 May 04 19:08:06.826096 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 147/283] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:06 2022] GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:07.439489 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-5943c08c-c584-40ec-9c95-c2aab9d7df60 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:07.440167 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-5943c08c-c584-40ec-9c95-c2aab9d7df60 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:07.446788 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5943c08c-c584-40ec-9c95-c2aab9d7df60 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:07.447229 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5943c08c-c584-40ec-9c95-c2aab9d7df60 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:07.447972 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5943c08c-c584-40ec-9c95-c2aab9d7df60 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:07.448399 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5943c08c-c584-40ec-9c95-c2aab9d7df60 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:07.467948 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-3391bf52-2f14-41e6-be62-ee290ced0348 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:07.468661 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-3391bf52-2f14-41e6-be62-ee290ced0348 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] [instance: 43177d93-a222-45c3-ac47-9ca78417f7c8] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:07.474895 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3391bf52-2f14-41e6-be62-ee290ced0348 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:07.475375 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3391bf52-2f14-41e6-be62-ee290ced0348 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:07.476143 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3391bf52-2f14-41e6-be62-ee290ced0348 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:07.476583 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3391bf52-2f14-41e6-be62-ee290ced0348 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:07.578103 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-5943c08c-c584-40ec-9c95-c2aab9d7df60 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:07.589087 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-5943c08c-c584-40ec-9c95-c2aab9d7df60 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:07.589850 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-5943c08c-c584-40ec-9c95-c2aab9d7df60 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:07.591041 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-5943c08c-c584-40ec-9c95-c2aab9d7df60 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1724 microversion: 2.20 time: 0.155813 May 04 19:08:07.591949 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 137/284] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:08:07 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:08:07.612701 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-3391bf52-2f14-41e6-be62-ee290ced0348 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1298cdaba25f478a9ae358f87942ce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253bbd0defee4faf92eb8453dd4728fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:07.620606 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-3391bf52-2f14-41e6-be62-ee290ced0348 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] 10.222.0.69 "GET /compute/v2.1/servers/43177d93-a222-45c3-ac47-9ca78417f7c8" status: 200 len: 1314 microversion: 2.1 time: 0.156460 May 04 19:08:07.621173 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 148/285] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:07 2022] GET /compute/v2.1/servers/43177d93-a222-45c3-ac47-9ca78417f7c8 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:08:07.842210 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-91008dd4-8045-4e31-82d3-d760013344b1 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:07.842808 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-91008dd4-8045-4e31-82d3-d760013344b1 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 150304bb-d8d1-4c08-93b6-fc07c69fd846] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:07.848660 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-91008dd4-8045-4e31-82d3-d760013344b1 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:07.849103 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-91008dd4-8045-4e31-82d3-d760013344b1 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:07.849885 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-91008dd4-8045-4e31-82d3-d760013344b1 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:07.850315 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-91008dd4-8045-4e31-82d3-d760013344b1 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:07.987048 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-91008dd4-8045-4e31-82d3-d760013344b1 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:07.994970 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-91008dd4-8045-4e31-82d3-d760013344b1 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846" status: 200 len: 1520 microversion: 2.1 time: 0.156568 May 04 19:08:07.995540 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 138/286] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:07 2022] GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:08.610767 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-4dce2270-e99a-465e-ab47-199dac38555b tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:08.611377 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-4dce2270-e99a-465e-ab47-199dac38555b tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:08.617808 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4dce2270-e99a-465e-ab47-199dac38555b tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:08.618259 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4dce2270-e99a-465e-ab47-199dac38555b tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:08.619018 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4dce2270-e99a-465e-ab47-199dac38555b tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:08.619452 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4dce2270-e99a-465e-ab47-199dac38555b tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:08.637373 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-2e60b9d6-7fcc-4f74-8a29-4813e38ec238 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:08.638149 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-2e60b9d6-7fcc-4f74-8a29-4813e38ec238 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] [instance: 43177d93-a222-45c3-ac47-9ca78417f7c8] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:08.644087 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2e60b9d6-7fcc-4f74-8a29-4813e38ec238 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:08.644536 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2e60b9d6-7fcc-4f74-8a29-4813e38ec238 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:08.645303 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2e60b9d6-7fcc-4f74-8a29-4813e38ec238 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:08.645829 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2e60b9d6-7fcc-4f74-8a29-4813e38ec238 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:08.747271 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-4dce2270-e99a-465e-ab47-199dac38555b tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:08.755012 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-4dce2270-e99a-465e-ab47-199dac38555b tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:08.756493 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-4dce2270-e99a-465e-ab47-199dac38555b tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:08.758184 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-4dce2270-e99a-465e-ab47-199dac38555b tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1724 microversion: 2.20 time: 0.150858 May 04 19:08:08.758817 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 149/287] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:08:08 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:08:08.781704 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-2e60b9d6-7fcc-4f74-8a29-4813e38ec238 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1298cdaba25f478a9ae358f87942ce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253bbd0defee4faf92eb8453dd4728fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:08.790445 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-2e60b9d6-7fcc-4f74-8a29-4813e38ec238 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] 10.222.0.69 "GET /compute/v2.1/servers/43177d93-a222-45c3-ac47-9ca78417f7c8" status: 200 len: 1314 microversion: 2.1 time: 0.156916 May 04 19:08:08.791292 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 139/288] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:08 2022] GET /compute/v2.1/servers/43177d93-a222-45c3-ac47-9ca78417f7c8 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:08:08.964873 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-3248c20e-dce1-4432-a328-29579072848d tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:08.965278 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-3248c20e-dce1-4432-a328-29579072848d tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:08.971463 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3248c20e-dce1-4432-a328-29579072848d tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:08.971916 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3248c20e-dce1-4432-a328-29579072848d tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:08.972692 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3248c20e-dce1-4432-a328-29579072848d tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:08.973155 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3248c20e-dce1-4432-a328-29579072848d tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:08.996176 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-3248c20e-dce1-4432-a328-29579072848d tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d/ips" status: 200 len: 145 microversion: 2.1 time: 0.035811 May 04 19:08:08.996737 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 150/289] 10.222.0.69 () {58 vars in 1247 bytes} [Wed May 4 19:08:08 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d/ips => generated 145 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:08:09.011908 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-5007d6b5-c50f-4b93-805c-73ba22a36e13 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:09.012552 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-5007d6b5-c50f-4b93-805c-73ba22a36e13 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 150304bb-d8d1-4c08-93b6-fc07c69fd846] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:09.018910 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5007d6b5-c50f-4b93-805c-73ba22a36e13 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:09.019356 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5007d6b5-c50f-4b93-805c-73ba22a36e13 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:09.020116 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5007d6b5-c50f-4b93-805c-73ba22a36e13 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:09.020549 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5007d6b5-c50f-4b93-805c-73ba22a36e13 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:09.151147 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-5007d6b5-c50f-4b93-805c-73ba22a36e13 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:09.158423 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-5007d6b5-c50f-4b93-805c-73ba22a36e13 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846" status: 200 len: 1520 microversion: 2.1 time: 0.150922 May 04 19:08:09.159003 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 140/290] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:09 2022] GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:09.778762 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-2f4c3839-0a67-4d69-9602-ff81153410c0 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:09.779368 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-2f4c3839-0a67-4d69-9602-ff81153410c0 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:09.785784 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2f4c3839-0a67-4d69-9602-ff81153410c0 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:09.786234 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2f4c3839-0a67-4d69-9602-ff81153410c0 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:09.786988 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2f4c3839-0a67-4d69-9602-ff81153410c0 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:09.787423 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2f4c3839-0a67-4d69-9602-ff81153410c0 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:09.808543 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-3c98ef53-6776-46b3-ae93-56d4e34b075e tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:09.809144 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-3c98ef53-6776-46b3-ae93-56d4e34b075e tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] [instance: 43177d93-a222-45c3-ac47-9ca78417f7c8] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:09.814890 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3c98ef53-6776-46b3-ae93-56d4e34b075e tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:09.815329 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3c98ef53-6776-46b3-ae93-56d4e34b075e tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:09.816086 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3c98ef53-6776-46b3-ae93-56d4e34b075e tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:09.816521 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3c98ef53-6776-46b3-ae93-56d4e34b075e tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:09.921057 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-2f4c3839-0a67-4d69-9602-ff81153410c0 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:09.928789 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-2f4c3839-0a67-4d69-9602-ff81153410c0 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:09.930306 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-2f4c3839-0a67-4d69-9602-ff81153410c0 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:09.931708 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-2f4c3839-0a67-4d69-9602-ff81153410c0 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1724 microversion: 2.20 time: 0.156858 May 04 19:08:09.932267 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 151/291] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:08:09 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:08:09.951966 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-3c98ef53-6776-46b3-ae93-56d4e34b075e tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1298cdaba25f478a9ae358f87942ce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253bbd0defee4faf92eb8453dd4728fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:09.959333 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-3c98ef53-6776-46b3-ae93-56d4e34b075e tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] 10.222.0.69 "GET /compute/v2.1/servers/43177d93-a222-45c3-ac47-9ca78417f7c8" status: 200 len: 1499 microversion: 2.1 time: 0.155201 May 04 19:08:09.960069 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 141/292] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:09 2022] GET /compute/v2.1/servers/43177d93-a222-45c3-ac47-9ca78417f7c8 => generated 1499 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:08:10.175318 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-52f7dd87-14f4-484e-acf4-b14a1a56abab tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:10.175983 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-52f7dd87-14f4-484e-acf4-b14a1a56abab tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 150304bb-d8d1-4c08-93b6-fc07c69fd846] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:10.182035 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-52f7dd87-14f4-484e-acf4-b14a1a56abab tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:10.182491 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-52f7dd87-14f4-484e-acf4-b14a1a56abab tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:10.183279 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-52f7dd87-14f4-484e-acf4-b14a1a56abab tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:10.183706 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-52f7dd87-14f4-484e-acf4-b14a1a56abab tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:10.315366 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-52f7dd87-14f4-484e-acf4-b14a1a56abab tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:10.323355 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-52f7dd87-14f4-484e-acf4-b14a1a56abab tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846" status: 200 len: 1520 microversion: 2.1 time: 0.151824 May 04 19:08:10.324089 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 152/293] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:10 2022] GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:10.610208 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-a2d774d0-c2ce-47f1-9a6e-e79f23042757 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:10.610702 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-a2d774d0-c2ce-47f1-9a6e-e79f23042757 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] [instance: 43177d93-a222-45c3-ac47-9ca78417f7c8] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:10.616502 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a2d774d0-c2ce-47f1-9a6e-e79f23042757 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:10.617443 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a2d774d0-c2ce-47f1-9a6e-e79f23042757 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:10.618229 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a2d774d0-c2ce-47f1-9a6e-e79f23042757 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:10.618666 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a2d774d0-c2ce-47f1-9a6e-e79f23042757 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:10.643212 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-a2d774d0-c2ce-47f1-9a6e-e79f23042757 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] [instance: 43177d93-a222-45c3-ac47-9ca78417f7c8] Going to try to terminate instance {{(pid=117125) delete /opt/stack/nova/nova/compute/api.py:2664}} May 04 19:08:10.719218 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-a2d774d0-c2ce-47f1-9a6e-e79f23042757 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] 10.222.0.69 "DELETE /compute/v2.1/servers/43177d93-a222-45c3-ac47-9ca78417f7c8" status: 204 len: 0 microversion: 2.1 time: 0.112207 May 04 19:08:10.719896 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 142/294] 10.222.0.69 () {58 vars in 1238 bytes} [Wed May 4 19:08:10 2022] DELETE /compute/v2.1/servers/43177d93-a222-45c3-ac47-9ca78417f7c8 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 04 19:08:10.731110 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-5baea74a-9402-41cb-8cd5-f160133c7a04 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:10.731756 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-5baea74a-9402-41cb-8cd5-f160133c7a04 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] [instance: 43177d93-a222-45c3-ac47-9ca78417f7c8] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:10.737856 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5baea74a-9402-41cb-8cd5-f160133c7a04 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:10.738302 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5baea74a-9402-41cb-8cd5-f160133c7a04 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:10.739066 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5baea74a-9402-41cb-8cd5-f160133c7a04 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:10.739499 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5baea74a-9402-41cb-8cd5-f160133c7a04 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:10.866509 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-5baea74a-9402-41cb-8cd5-f160133c7a04 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1298cdaba25f478a9ae358f87942ce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253bbd0defee4faf92eb8453dd4728fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:10.874228 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-5baea74a-9402-41cb-8cd5-f160133c7a04 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] 10.222.0.69 "GET /compute/v2.1/servers/43177d93-a222-45c3-ac47-9ca78417f7c8" status: 200 len: 1505 microversion: 2.1 time: 0.149431 May 04 19:08:10.874783 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 153/295] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:10 2022] GET /compute/v2.1/servers/43177d93-a222-45c3-ac47-9ca78417f7c8 => generated 1505 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:10.950895 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-da9bbcd7-a75f-474a-bf4a-9b3a1b192325 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:10.951580 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-da9bbcd7-a75f-474a-bf4a-9b3a1b192325 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:10.957530 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-da9bbcd7-a75f-474a-bf4a-9b3a1b192325 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:10.957969 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-da9bbcd7-a75f-474a-bf4a-9b3a1b192325 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:10.958752 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-da9bbcd7-a75f-474a-bf4a-9b3a1b192325 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:10.959181 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-da9bbcd7-a75f-474a-bf4a-9b3a1b192325 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:11.083786 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-da9bbcd7-a75f-474a-bf4a-9b3a1b192325 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:11.091412 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-da9bbcd7-a75f-474a-bf4a-9b3a1b192325 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:11.092953 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-da9bbcd7-a75f-474a-bf4a-9b3a1b192325 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:11.094136 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-da9bbcd7-a75f-474a-bf4a-9b3a1b192325 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1724 microversion: 2.20 time: 0.147537 May 04 19:08:11.094693 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 143/296] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:08:10 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:08:11.341235 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-1cfb1889-7107-4b1c-91d7-b5883f2c49ac tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:11.341911 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-1cfb1889-7107-4b1c-91d7-b5883f2c49ac tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 150304bb-d8d1-4c08-93b6-fc07c69fd846] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:11.347794 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1cfb1889-7107-4b1c-91d7-b5883f2c49ac tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:11.348236 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1cfb1889-7107-4b1c-91d7-b5883f2c49ac tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:11.348991 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1cfb1889-7107-4b1c-91d7-b5883f2c49ac tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:11.349421 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1cfb1889-7107-4b1c-91d7-b5883f2c49ac tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:11.473780 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-1cfb1889-7107-4b1c-91d7-b5883f2c49ac tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:11.481943 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-1cfb1889-7107-4b1c-91d7-b5883f2c49ac tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846" status: 200 len: 1520 microversion: 2.1 time: 0.145814 May 04 19:08:11.482504 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 154/297] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:11 2022] GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846 => generated 1520 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:11.891903 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-ebc85191-e68a-48f4-87ef-f67864d007e4 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:11.892875 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-ebc85191-e68a-48f4-87ef-f67864d007e4 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] [instance: 43177d93-a222-45c3-ac47-9ca78417f7c8] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:11.899502 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ebc85191-e68a-48f4-87ef-f67864d007e4 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:11.899959 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ebc85191-e68a-48f4-87ef-f67864d007e4 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:11.900755 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ebc85191-e68a-48f4-87ef-f67864d007e4 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:11.901193 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ebc85191-e68a-48f4-87ef-f67864d007e4 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:12.038637 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-ebc85191-e68a-48f4-87ef-f67864d007e4 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1298cdaba25f478a9ae358f87942ce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253bbd0defee4faf92eb8453dd4728fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:12.048371 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-ebc85191-e68a-48f4-87ef-f67864d007e4 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] 10.222.0.69 "GET /compute/v2.1/servers/43177d93-a222-45c3-ac47-9ca78417f7c8" status: 200 len: 1505 microversion: 2.1 time: 0.160220 May 04 19:08:12.048998 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 144/298] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:11 2022] GET /compute/v2.1/servers/43177d93-a222-45c3-ac47-9ca78417f7c8 => generated 1505 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:12.112099 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-9c5cba8a-8ef5-44bb-ab2b-f36a42084d17 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:12.112702 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-9c5cba8a-8ef5-44bb-ab2b-f36a42084d17 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:12.119513 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9c5cba8a-8ef5-44bb-ab2b-f36a42084d17 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:12.119959 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9c5cba8a-8ef5-44bb-ab2b-f36a42084d17 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:12.120710 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9c5cba8a-8ef5-44bb-ab2b-f36a42084d17 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:12.121141 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9c5cba8a-8ef5-44bb-ab2b-f36a42084d17 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:12.247089 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-9c5cba8a-8ef5-44bb-ab2b-f36a42084d17 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:12.254947 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-9c5cba8a-8ef5-44bb-ab2b-f36a42084d17 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:12.256460 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-9c5cba8a-8ef5-44bb-ab2b-f36a42084d17 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:12.258194 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-9c5cba8a-8ef5-44bb-ab2b-f36a42084d17 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1724 microversion: 2.20 time: 0.149452 May 04 19:08:12.258767 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 155/299] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:08:12 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:08:12.500611 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-9cf71ed7-49bd-468d-b056-74103d8a8d57 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:12.501229 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-9cf71ed7-49bd-468d-b056-74103d8a8d57 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 150304bb-d8d1-4c08-93b6-fc07c69fd846] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:12.507278 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9cf71ed7-49bd-468d-b056-74103d8a8d57 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:12.507817 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9cf71ed7-49bd-468d-b056-74103d8a8d57 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:12.509161 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9cf71ed7-49bd-468d-b056-74103d8a8d57 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:12.509963 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9cf71ed7-49bd-468d-b056-74103d8a8d57 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:12.639925 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-9cf71ed7-49bd-468d-b056-74103d8a8d57 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:12.647435 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-9cf71ed7-49bd-468d-b056-74103d8a8d57 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846" status: 200 len: 1520 microversion: 2.1 time: 0.151808 May 04 19:08:12.648006 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 145/300] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:12 2022] GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:13.065539 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-2e1056a0-bbc9-4077-97af-4b04fd8d56df tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:13.066179 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-2e1056a0-bbc9-4077-97af-4b04fd8d56df tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] [instance: 43177d93-a222-45c3-ac47-9ca78417f7c8] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:13.072333 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2e1056a0-bbc9-4077-97af-4b04fd8d56df tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:13.072789 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2e1056a0-bbc9-4077-97af-4b04fd8d56df tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:13.073820 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2e1056a0-bbc9-4077-97af-4b04fd8d56df tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:13.074073 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2e1056a0-bbc9-4077-97af-4b04fd8d56df tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:13.135670 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-37bd97ea-d5b6-41bc-aab0-0c4336b65417 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2b79ee3f-b092-4e6b-bc3e-4a8ce5fae5d0"}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:08:13.136801 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-37bd97ea-d5b6-41bc-aab0-0c4336b65417 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:13.142986 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-37bd97ea-d5b6-41bc-aab0-0c4336b65417 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:13.143433 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-37bd97ea-d5b6-41bc-aab0-0c4336b65417 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:13.144196 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-37bd97ea-d5b6-41bc-aab0-0c4336b65417 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:13.144633 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-37bd97ea-d5b6-41bc-aab0-0c4336b65417 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:13.273418 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-2e1056a0-bbc9-4077-97af-4b04fd8d56df tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1298cdaba25f478a9ae358f87942ce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253bbd0defee4faf92eb8453dd4728fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:13.281332 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-2e1056a0-bbc9-4077-97af-4b04fd8d56df tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] 10.222.0.69 "GET /compute/v2.1/servers/43177d93-a222-45c3-ac47-9ca78417f7c8" status: 200 len: 1505 microversion: 2.1 time: 0.219649 May 04 19:08:13.282014 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 156/301] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:13 2022] GET /compute/v2.1/servers/43177d93-a222-45c3-ac47-9ca78417f7c8 => generated 1505 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:13.286719 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-2c3ffc73-232e-4852-a390-e9b35e3a989d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:13.287404 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-2c3ffc73-232e-4852-a390-e9b35e3a989d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:13.293106 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2c3ffc73-232e-4852-a390-e9b35e3a989d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:13.293665 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2c3ffc73-232e-4852-a390-e9b35e3a989d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:13.294498 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2c3ffc73-232e-4852-a390-e9b35e3a989d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:13.295002 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2c3ffc73-232e-4852-a390-e9b35e3a989d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:13.498596 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-2c3ffc73-232e-4852-a390-e9b35e3a989d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:13.506403 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-2c3ffc73-232e-4852-a390-e9b35e3a989d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:13.507907 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-2c3ffc73-232e-4852-a390-e9b35e3a989d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:13.509580 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-2c3ffc73-232e-4852-a390-e9b35e3a989d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1724 microversion: 2.20 time: 0.226557 May 04 19:08:13.510136 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 157/302] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:08:13 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1724 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:08:13.664837 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-82d51465-267b-4da6-a609-731d9b65a195 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:13.665423 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-82d51465-267b-4da6-a609-731d9b65a195 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 150304bb-d8d1-4c08-93b6-fc07c69fd846] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:13.691036 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-82d51465-267b-4da6-a609-731d9b65a195 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:13.691487 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-82d51465-267b-4da6-a609-731d9b65a195 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:13.692264 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-82d51465-267b-4da6-a609-731d9b65a195 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:13.692694 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-82d51465-267b-4da6-a609-731d9b65a195 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:13.800330 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-37bd97ea-d5b6-41bc-aab0-0c4336b65417 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "POST /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.668675 May 04 19:08:13.800969 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 146/303] 10.222.0.69 () {60 vars in 1322 bytes} [Wed May 4 19:08:13 2022] POST /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d/os-volume_attachments => generated 194 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 04 19:08:13.806932 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-d2edaccf-50f7-438c-a899-6795566f1275 req-dd2b94ac-2ba9-4cdd-bb93-9803dc02f24f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43177d93-a222-45c3-ac47-9ca78417f7c8", "name": "network-vif-deleted", "tag": "413f0c9f-3f58-4dfd-996c-fa7d7b423966"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:08:13.816078 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-d2edaccf-50f7-438c-a899-6795566f1275 req-dd2b94ac-2ba9-4cdd-bb93-9803dc02f24f service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:13.816736 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-d2edaccf-50f7-438c-a899-6795566f1275 req-dd2b94ac-2ba9-4cdd-bb93-9803dc02f24f service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:13.829407 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-d2edaccf-50f7-438c-a899-6795566f1275 req-dd2b94ac-2ba9-4cdd-bb93-9803dc02f24f service nova] Creating event network-vif-deleted:413f0c9f-3f58-4dfd-996c-fa7d7b423966 for instance 43177d93-a222-45c3-ac47-9ca78417f7c8 on hv-cinder-83090 May 04 19:08:13.837208 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-d2edaccf-50f7-438c-a899-6795566f1275 req-dd2b94ac-2ba9-4cdd-bb93-9803dc02f24f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034572 May 04 19:08:13.838342 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 147/304] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:08:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:08:13.840772 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-82d51465-267b-4da6-a609-731d9b65a195 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:13.848588 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-82d51465-267b-4da6-a609-731d9b65a195 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846" status: 200 len: 1520 microversion: 2.1 time: 0.187778 May 04 19:08:13.851775 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 158/305] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:13 2022] GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846 => generated 1520 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:14.299147 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-61546a38-76ce-4042-9925-79e9d17b0ff0 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:14.299838 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-61546a38-76ce-4042-9925-79e9d17b0ff0 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] [instance: 43177d93-a222-45c3-ac47-9ca78417f7c8] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:14.306489 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-61546a38-76ce-4042-9925-79e9d17b0ff0 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:14.306927 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-61546a38-76ce-4042-9925-79e9d17b0ff0 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:14.307686 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-61546a38-76ce-4042-9925-79e9d17b0ff0 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:14.308123 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-61546a38-76ce-4042-9925-79e9d17b0ff0 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:14.339110 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-61546a38-76ce-4042-9925-79e9d17b0ff0 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:14.339557 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-61546a38-76ce-4042-9925-79e9d17b0ff0 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:14.340001 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.objects.instance [None req-61546a38-76ce-4042-9925-79e9d17b0ff0 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lazy-loading 'fault' on Instance uuid 43177d93-a222-45c3-ac47-9ca78417f7c8 {{(pid=117125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 04 19:08:14.380820 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-61546a38-76ce-4042-9925-79e9d17b0ff0 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1298cdaba25f478a9ae358f87942ce8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253bbd0defee4faf92eb8453dd4728fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:14.389779 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-61546a38-76ce-4042-9925-79e9d17b0ff0 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] 10.222.0.69 "GET /compute/v2.1/servers/43177d93-a222-45c3-ac47-9ca78417f7c8" status: 200 len: 1304 microversion: 2.1 time: 0.095050 May 04 19:08:14.390662 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 148/306] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:14 2022] GET /compute/v2.1/servers/43177d93-a222-45c3-ac47-9ca78417f7c8 => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:14.528473 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-07dcd738-7fbf-48d7-aba6-d8374cb07676 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:14.528991 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-07dcd738-7fbf-48d7-aba6-d8374cb07676 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:14.535264 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-07dcd738-7fbf-48d7-aba6-d8374cb07676 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:14.535712 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-07dcd738-7fbf-48d7-aba6-d8374cb07676 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:14.536471 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-07dcd738-7fbf-48d7-aba6-d8374cb07676 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:14.536907 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-07dcd738-7fbf-48d7-aba6-d8374cb07676 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:14.662922 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-07dcd738-7fbf-48d7-aba6-d8374cb07676 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:14.671304 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-07dcd738-7fbf-48d7-aba6-d8374cb07676 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:14.672809 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-07dcd738-7fbf-48d7-aba6-d8374cb07676 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:14.673999 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-07dcd738-7fbf-48d7-aba6-d8374cb07676 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1724 microversion: 2.20 time: 0.150139 May 04 19:08:14.674558 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 159/307] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:08:14 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:08:14.867199 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-25072050-f795-4d60-93e1-b394bf949c45 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:14.867812 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-25072050-f795-4d60-93e1-b394bf949c45 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 150304bb-d8d1-4c08-93b6-fc07c69fd846] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:14.874499 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-25072050-f795-4d60-93e1-b394bf949c45 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:14.874944 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-25072050-f795-4d60-93e1-b394bf949c45 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:14.875708 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-25072050-f795-4d60-93e1-b394bf949c45 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:14.876139 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-25072050-f795-4d60-93e1-b394bf949c45 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:15.012375 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-25072050-f795-4d60-93e1-b394bf949c45 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:15.019978 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-25072050-f795-4d60-93e1-b394bf949c45 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846" status: 200 len: 1520 microversion: 2.1 time: 0.156568 May 04 19:08:15.020501 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 149/308] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:14 2022] GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:15.407906 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-f6af15b6-95aa-46a1-b7fd-82d43ad34b01 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:15.408517 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-f6af15b6-95aa-46a1-b7fd-82d43ad34b01 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] [instance: 43177d93-a222-45c3-ac47-9ca78417f7c8] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:15.414292 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f6af15b6-95aa-46a1-b7fd-82d43ad34b01 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:15.414746 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f6af15b6-95aa-46a1-b7fd-82d43ad34b01 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:15.415507 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f6af15b6-95aa-46a1-b7fd-82d43ad34b01 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:15.415943 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f6af15b6-95aa-46a1-b7fd-82d43ad34b01 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:15.430921 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.wsgi [None req-f6af15b6-95aa-46a1-b7fd-82d43ad34b01 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] HTTP exception thrown: Instance 43177d93-a222-45c3-ac47-9ca78417f7c8 could not be found. May 04 19:08:15.431521 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-f6af15b6-95aa-46a1-b7fd-82d43ad34b01 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] Returning 404 to user: Instance 43177d93-a222-45c3-ac47-9ca78417f7c8 could not be found. {{(pid=117124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 04 19:08:15.432394 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-f6af15b6-95aa-46a1-b7fd-82d43ad34b01 tempest-VolumesActionsTest-666432869 tempest-VolumesActionsTest-666432869-project] 10.222.0.69 "GET /compute/v2.1/servers/43177d93-a222-45c3-ac47-9ca78417f7c8" status: 404 len: 111 microversion: 2.1 time: 0.028326 May 04 19:08:15.433004 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 160/309] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:15 2022] GET /compute/v2.1/servers/43177d93-a222-45c3-ac47-9ca78417f7c8 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 04 19:08:15.691943 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-29f4978f-8f07-4719-84c7-7bd8e6aeb1c4 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:15.692698 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-29f4978f-8f07-4719-84c7-7bd8e6aeb1c4 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:15.699142 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-29f4978f-8f07-4719-84c7-7bd8e6aeb1c4 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:15.699596 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-29f4978f-8f07-4719-84c7-7bd8e6aeb1c4 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:15.700413 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-29f4978f-8f07-4719-84c7-7bd8e6aeb1c4 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:15.700789 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-29f4978f-8f07-4719-84c7-7bd8e6aeb1c4 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:15.831261 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-29f4978f-8f07-4719-84c7-7bd8e6aeb1c4 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:15.839599 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-29f4978f-8f07-4719-84c7-7bd8e6aeb1c4 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:15.841045 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-29f4978f-8f07-4719-84c7-7bd8e6aeb1c4 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:15.842234 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-29f4978f-8f07-4719-84c7-7bd8e6aeb1c4 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1724 microversion: 2.20 time: 0.154372 May 04 19:08:15.842791 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 150/310] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:08:15 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:08:16.037391 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-01fc9be0-08b1-4130-937c-52506423a1f7 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:16.038036 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-01fc9be0-08b1-4130-937c-52506423a1f7 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 150304bb-d8d1-4c08-93b6-fc07c69fd846] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:16.045080 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-01fc9be0-08b1-4130-937c-52506423a1f7 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:16.045557 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-01fc9be0-08b1-4130-937c-52506423a1f7 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:16.046349 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-01fc9be0-08b1-4130-937c-52506423a1f7 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:16.046773 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-01fc9be0-08b1-4130-937c-52506423a1f7 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:16.175001 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-01fc9be0-08b1-4130-937c-52506423a1f7 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:16.182492 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-01fc9be0-08b1-4130-937c-52506423a1f7 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846" status: 200 len: 1520 microversion: 2.1 time: 0.148895 May 04 19:08:16.183040 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 161/311] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:16 2022] GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:16.860599 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-632b7ed8-3bc0-4895-9bd0-03a8be5113e9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:16.861205 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-632b7ed8-3bc0-4895-9bd0-03a8be5113e9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:16.868138 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-632b7ed8-3bc0-4895-9bd0-03a8be5113e9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:16.868577 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-632b7ed8-3bc0-4895-9bd0-03a8be5113e9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:16.869334 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-632b7ed8-3bc0-4895-9bd0-03a8be5113e9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:16.869794 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-632b7ed8-3bc0-4895-9bd0-03a8be5113e9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:17.000597 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-632b7ed8-3bc0-4895-9bd0-03a8be5113e9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:17.008435 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-632b7ed8-3bc0-4895-9bd0-03a8be5113e9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:17.010093 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-632b7ed8-3bc0-4895-9bd0-03a8be5113e9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:17.011158 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-632b7ed8-3bc0-4895-9bd0-03a8be5113e9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1724 microversion: 2.20 time: 0.154791 May 04 19:08:17.011718 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 151/312] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:08:16 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:08:17.198472 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-b60d0582-b204-4ca2-9de8-9e463dde3419 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:17.199123 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-b60d0582-b204-4ca2-9de8-9e463dde3419 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 150304bb-d8d1-4c08-93b6-fc07c69fd846] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:17.205437 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b60d0582-b204-4ca2-9de8-9e463dde3419 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:17.205922 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b60d0582-b204-4ca2-9de8-9e463dde3419 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:17.206691 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b60d0582-b204-4ca2-9de8-9e463dde3419 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:17.207137 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b60d0582-b204-4ca2-9de8-9e463dde3419 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:17.337730 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-b60d0582-b204-4ca2-9de8-9e463dde3419 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:17.344978 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-b60d0582-b204-4ca2-9de8-9e463dde3419 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846" status: 200 len: 1520 microversion: 2.1 time: 0.150317 May 04 19:08:17.345550 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 162/313] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:17 2022] GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:18.029957 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-47c115ee-b4eb-4f7a-8eb8-6228822eeae1 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:18.030587 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-47c115ee-b4eb-4f7a-8eb8-6228822eeae1 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:18.036947 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-47c115ee-b4eb-4f7a-8eb8-6228822eeae1 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:18.037393 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-47c115ee-b4eb-4f7a-8eb8-6228822eeae1 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:18.038182 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-47c115ee-b4eb-4f7a-8eb8-6228822eeae1 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:18.038617 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-47c115ee-b4eb-4f7a-8eb8-6228822eeae1 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:18.165801 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-47c115ee-b4eb-4f7a-8eb8-6228822eeae1 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:18.173380 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-47c115ee-b4eb-4f7a-8eb8-6228822eeae1 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:18.174894 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-47c115ee-b4eb-4f7a-8eb8-6228822eeae1 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:18.176039 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-47c115ee-b4eb-4f7a-8eb8-6228822eeae1 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1724 microversion: 2.20 time: 0.149923 May 04 19:08:18.176596 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 152/314] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:08:18 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:08:18.362279 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-00bf0bac-6709-4079-8962-50daa39298b6 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:18.362933 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-00bf0bac-6709-4079-8962-50daa39298b6 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 150304bb-d8d1-4c08-93b6-fc07c69fd846] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:18.369873 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-00bf0bac-6709-4079-8962-50daa39298b6 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:18.370327 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-00bf0bac-6709-4079-8962-50daa39298b6 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:18.371093 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-00bf0bac-6709-4079-8962-50daa39298b6 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:18.371532 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-00bf0bac-6709-4079-8962-50daa39298b6 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:18.497300 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-00bf0bac-6709-4079-8962-50daa39298b6 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:18.504602 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-00bf0bac-6709-4079-8962-50daa39298b6 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846" status: 200 len: 1520 microversion: 2.1 time: 0.146208 May 04 19:08:18.505183 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 163/315] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:18 2022] GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846 => generated 1520 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:19.194404 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-fd37c36a-108e-4bcb-9032-4a2d703fbc16 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:19.195001 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-fd37c36a-108e-4bcb-9032-4a2d703fbc16 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:19.201721 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-fd37c36a-108e-4bcb-9032-4a2d703fbc16 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:19.202165 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-fd37c36a-108e-4bcb-9032-4a2d703fbc16 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:19.202913 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-fd37c36a-108e-4bcb-9032-4a2d703fbc16 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:19.203344 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-fd37c36a-108e-4bcb-9032-4a2d703fbc16 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:19.325964 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-fd37c36a-108e-4bcb-9032-4a2d703fbc16 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:19.333504 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-fd37c36a-108e-4bcb-9032-4a2d703fbc16 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:19.335103 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-fd37c36a-108e-4bcb-9032-4a2d703fbc16 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:19.336873 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-fd37c36a-108e-4bcb-9032-4a2d703fbc16 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1724 microversion: 2.20 time: 0.145752 May 04 19:08:19.337434 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 153/316] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:08:19 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1724 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:08:19.524634 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-a22383c3-4711-47b7-9a01-fef6bccaf7ac tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:19.525165 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-a22383c3-4711-47b7-9a01-fef6bccaf7ac tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 150304bb-d8d1-4c08-93b6-fc07c69fd846] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:19.531417 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a22383c3-4711-47b7-9a01-fef6bccaf7ac tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:19.531868 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a22383c3-4711-47b7-9a01-fef6bccaf7ac tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:19.532617 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a22383c3-4711-47b7-9a01-fef6bccaf7ac tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:19.533047 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a22383c3-4711-47b7-9a01-fef6bccaf7ac tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:19.665490 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-a22383c3-4711-47b7-9a01-fef6bccaf7ac tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:19.672715 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-a22383c3-4711-47b7-9a01-fef6bccaf7ac tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846" status: 200 len: 1520 microversion: 2.1 time: 0.152563 May 04 19:08:19.673408 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 164/317] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:19 2022] GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:20.355641 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-606f8797-67da-4cd3-8e2c-9e3416895c77 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:20.356244 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-606f8797-67da-4cd3-8e2c-9e3416895c77 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:20.362471 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-606f8797-67da-4cd3-8e2c-9e3416895c77 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:20.362910 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-606f8797-67da-4cd3-8e2c-9e3416895c77 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:20.363658 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-606f8797-67da-4cd3-8e2c-9e3416895c77 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:20.364091 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-606f8797-67da-4cd3-8e2c-9e3416895c77 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:20.492070 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-606f8797-67da-4cd3-8e2c-9e3416895c77 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:20.499819 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-606f8797-67da-4cd3-8e2c-9e3416895c77 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:20.501311 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-606f8797-67da-4cd3-8e2c-9e3416895c77 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:20.502510 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-606f8797-67da-4cd3-8e2c-9e3416895c77 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1724 microversion: 2.20 time: 0.151360 May 04 19:08:20.503069 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 154/318] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:08:20 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:08:20.690090 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-208f46de-d484-4e55-b0d6-27b4e9c913df tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:20.690746 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-208f46de-d484-4e55-b0d6-27b4e9c913df tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 150304bb-d8d1-4c08-93b6-fc07c69fd846] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:20.697510 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-208f46de-d484-4e55-b0d6-27b4e9c913df tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:20.697842 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-208f46de-d484-4e55-b0d6-27b4e9c913df tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:20.698715 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-208f46de-d484-4e55-b0d6-27b4e9c913df tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:20.699156 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-208f46de-d484-4e55-b0d6-27b4e9c913df tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:20.723059 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-21c4a63d-e0e3-4b44-b524-7387b5cd47f5 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f693a4bc-47e3-4711-918b-4dfe539fb20b", "device": "/dev/sdb"}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:08:20.724697 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-21c4a63d-e0e3-4b44-b524-7387b5cd47f5 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] [instance: 9d1266bd-77ec-4a0d-a557-71dafe7c5436] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:20.730503 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-21c4a63d-e0e3-4b44-b524-7387b5cd47f5 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:20.730947 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-21c4a63d-e0e3-4b44-b524-7387b5cd47f5 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:20.731713 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-21c4a63d-e0e3-4b44-b524-7387b5cd47f5 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:20.732126 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-21c4a63d-e0e3-4b44-b524-7387b5cd47f5 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:20.828730 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-208f46de-d484-4e55-b0d6-27b4e9c913df tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:20.838020 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-208f46de-d484-4e55-b0d6-27b4e9c913df tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846" status: 200 len: 1520 microversion: 2.1 time: 0.151723 May 04 19:08:20.838954 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 165/319] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:20 2022] GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:21.510936 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-21c4a63d-e0e3-4b44-b524-7387b5cd47f5 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] 10.222.0.69 "POST /compute/v2.1/servers/9d1266bd-77ec-4a0d-a557-71dafe7c5436/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.791608 May 04 19:08:21.511631 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 155/320] 10.222.0.69 () {60 vars in 1322 bytes} [Wed May 4 19:08:20 2022] POST /compute/v2.1/servers/9d1266bd-77ec-4a0d-a557-71dafe7c5436/os-volume_attachments => generated 194 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 04 19:08:21.521385 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-b16b9d60-90e2-463a-9650-cffc5ff23132 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:21.522046 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-b16b9d60-90e2-463a-9650-cffc5ff23132 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:21.528512 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b16b9d60-90e2-463a-9650-cffc5ff23132 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:21.528954 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b16b9d60-90e2-463a-9650-cffc5ff23132 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:21.536489 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b16b9d60-90e2-463a-9650-cffc5ff23132 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:21.537195 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b16b9d60-90e2-463a-9650-cffc5ff23132 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:21.676301 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-b16b9d60-90e2-463a-9650-cffc5ff23132 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:21.685225 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-b16b9d60-90e2-463a-9650-cffc5ff23132 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:21.686938 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-b16b9d60-90e2-463a-9650-cffc5ff23132 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:21.688318 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-b16b9d60-90e2-463a-9650-cffc5ff23132 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1724 microversion: 2.20 time: 0.171355 May 04 19:08:21.688981 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 166/321] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:08:21 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 04 19:08:21.856914 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-95c43fca-cc01-4e91-8b45-ad5c268999fa tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:21.857988 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-95c43fca-cc01-4e91-8b45-ad5c268999fa tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 150304bb-d8d1-4c08-93b6-fc07c69fd846] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:21.871589 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-95c43fca-cc01-4e91-8b45-ad5c268999fa tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:21.872049 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-95c43fca-cc01-4e91-8b45-ad5c268999fa tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:21.872836 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-95c43fca-cc01-4e91-8b45-ad5c268999fa tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:21.873285 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-95c43fca-cc01-4e91-8b45-ad5c268999fa tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:22.034218 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-95c43fca-cc01-4e91-8b45-ad5c268999fa tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:22.046071 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-95c43fca-cc01-4e91-8b45-ad5c268999fa tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846" status: 200 len: 1520 microversion: 2.1 time: 0.193741 May 04 19:08:22.047199 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 156/322] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:21 2022] GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846 => generated 1520 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:22.385304 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-70fcede0-680a-4dd5-9f90-04200be14a18 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:08:22.392460 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-70fcede0-680a-4dd5-9f90-04200be14a18 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:22.392911 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-70fcede0-680a-4dd5-9f90-04200be14a18 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:22.453423 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-70fcede0-680a-4dd5-9f90-04200be14a18 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Going to try to stop instance {{(pid=117124) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 04 19:08:22.509814 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-70fcede0-680a-4dd5-9f90-04200be14a18 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "POST /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d/action" status: 202 len: 0 microversion: 2.1 time: 0.128589 May 04 19:08:22.515027 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 167/323] 10.222.0.69 () {60 vars in 1277 bytes} [Wed May 4 19:08:22 2022] POST /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 04 19:08:22.519724 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-7a57b293-2163-44a2-82b8-07e71178a267 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:22.520343 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-7a57b293-2163-44a2-82b8-07e71178a267 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:22.532268 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7a57b293-2163-44a2-82b8-07e71178a267 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:22.532721 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7a57b293-2163-44a2-82b8-07e71178a267 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:22.533519 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7a57b293-2163-44a2-82b8-07e71178a267 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:22.534215 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7a57b293-2163-44a2-82b8-07e71178a267 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:22.706111 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-7a57b293-2163-44a2-82b8-07e71178a267 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:22.708558 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-def75f46-b7d4-42a3-9159-11e573e3155e tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:22.710460 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-def75f46-b7d4-42a3-9159-11e573e3155e tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:22.715503 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-7a57b293-2163-44a2-82b8-07e71178a267 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1721 microversion: 2.1 time: 0.199873 May 04 19:08:22.716872 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 157/324] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:22 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1721 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:22.727868 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-def75f46-b7d4-42a3-9159-11e573e3155e tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:22.730518 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-def75f46-b7d4-42a3-9159-11e573e3155e tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:22.732286 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-def75f46-b7d4-42a3-9159-11e573e3155e tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:22.732843 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-def75f46-b7d4-42a3-9159-11e573e3155e tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:22.876213 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-def75f46-b7d4-42a3-9159-11e573e3155e tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:22.889592 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-def75f46-b7d4-42a3-9159-11e573e3155e tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:22.893010 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-def75f46-b7d4-42a3-9159-11e573e3155e tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:22.895596 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-def75f46-b7d4-42a3-9159-11e573e3155e tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1724 microversion: 2.20 time: 0.192694 May 04 19:08:22.896495 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 168/325] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:08:22 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1724 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 04 19:08:23.063726 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-ed9f1ed6-2d00-454b-98dc-659494a5c08a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:23.064632 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-ed9f1ed6-2d00-454b-98dc-659494a5c08a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 150304bb-d8d1-4c08-93b6-fc07c69fd846] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:23.071650 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ed9f1ed6-2d00-454b-98dc-659494a5c08a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:23.072409 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ed9f1ed6-2d00-454b-98dc-659494a5c08a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:23.073421 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ed9f1ed6-2d00-454b-98dc-659494a5c08a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:23.074096 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ed9f1ed6-2d00-454b-98dc-659494a5c08a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:23.217723 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-ed9f1ed6-2d00-454b-98dc-659494a5c08a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:23.228026 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-ed9f1ed6-2d00-454b-98dc-659494a5c08a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846" status: 200 len: 1520 microversion: 2.1 time: 0.168010 May 04 19:08:23.229415 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 158/326] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:23 2022] GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:23.733860 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-9b406bb3-7971-4f03-94ce-c86cb03c86ac tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:23.735348 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-9b406bb3-7971-4f03-94ce-c86cb03c86ac tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:23.743379 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9b406bb3-7971-4f03-94ce-c86cb03c86ac tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:23.744000 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9b406bb3-7971-4f03-94ce-c86cb03c86ac tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:23.745022 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9b406bb3-7971-4f03-94ce-c86cb03c86ac tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:23.745740 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9b406bb3-7971-4f03-94ce-c86cb03c86ac tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:23.922352 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-9b406bb3-7971-4f03-94ce-c86cb03c86ac tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:23.926276 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-b7a091a0-6887-439d-b367-5628ccd37284 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:23.926985 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-b7a091a0-6887-439d-b367-5628ccd37284 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:23.932483 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-9b406bb3-7971-4f03-94ce-c86cb03c86ac tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1721 microversion: 2.1 time: 0.202616 May 04 19:08:23.933277 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 169/327] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:23 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1721 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:23.941547 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b7a091a0-6887-439d-b367-5628ccd37284 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:23.942031 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b7a091a0-6887-439d-b367-5628ccd37284 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:23.942919 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b7a091a0-6887-439d-b367-5628ccd37284 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:23.943319 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b7a091a0-6887-439d-b367-5628ccd37284 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:24.143485 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-b7a091a0-6887-439d-b367-5628ccd37284 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:24.151562 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-b7a091a0-6887-439d-b367-5628ccd37284 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:24.153079 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-b7a091a0-6887-439d-b367-5628ccd37284 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:24.154282 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-b7a091a0-6887-439d-b367-5628ccd37284 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1745 microversion: 2.20 time: 0.241533 May 04 19:08:24.155155 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 159/328] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:08:23 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1745 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:08:24.246302 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-e80790e6-6efc-4a98-b055-d5256c45e17c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:24.247094 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-e80790e6-6efc-4a98-b055-d5256c45e17c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 150304bb-d8d1-4c08-93b6-fc07c69fd846] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:24.254105 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e80790e6-6efc-4a98-b055-d5256c45e17c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:24.254760 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e80790e6-6efc-4a98-b055-d5256c45e17c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:24.255790 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e80790e6-6efc-4a98-b055-d5256c45e17c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:24.256576 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e80790e6-6efc-4a98-b055-d5256c45e17c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:24.408996 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-e80790e6-6efc-4a98-b055-d5256c45e17c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:24.417446 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-e80790e6-6efc-4a98-b055-d5256c45e17c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846" status: 200 len: 1520 microversion: 2.1 time: 0.175592 May 04 19:08:24.418140 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 170/329] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:24 2022] GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846 => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:24.950699 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-aec1706e-9ee3-438c-af83-d99a48279902 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:24.951332 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-aec1706e-9ee3-438c-af83-d99a48279902 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:24.962021 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-aec1706e-9ee3-438c-af83-d99a48279902 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:24.962726 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-aec1706e-9ee3-438c-af83-d99a48279902 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:24.963683 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-aec1706e-9ee3-438c-af83-d99a48279902 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:24.964280 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-aec1706e-9ee3-438c-af83-d99a48279902 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:25.125437 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-aec1706e-9ee3-438c-af83-d99a48279902 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:25.135277 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-aec1706e-9ee3-438c-af83-d99a48279902 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1721 microversion: 2.1 time: 0.188547 May 04 19:08:25.136185 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 160/330] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:24 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1721 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:08:25.172246 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-b098634e-9764-426f-8f57-0d4e5b9c6350 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:25.173543 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-b098634e-9764-426f-8f57-0d4e5b9c6350 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:25.181349 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b098634e-9764-426f-8f57-0d4e5b9c6350 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:25.181829 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b098634e-9764-426f-8f57-0d4e5b9c6350 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:25.182608 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b098634e-9764-426f-8f57-0d4e5b9c6350 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:25.183574 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b098634e-9764-426f-8f57-0d4e5b9c6350 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:25.325627 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-b098634e-9764-426f-8f57-0d4e5b9c6350 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:25.335001 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-b098634e-9764-426f-8f57-0d4e5b9c6350 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:25.336578 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-b098634e-9764-426f-8f57-0d4e5b9c6350 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:25.337993 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-b098634e-9764-426f-8f57-0d4e5b9c6350 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1745 microversion: 2.20 time: 0.169800 May 04 19:08:25.338713 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 171/331] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:08:25 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1745 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:08:25.436371 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-99cae1fb-d799-4b2f-826c-2e23beaa705a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:25.437175 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-99cae1fb-d799-4b2f-826c-2e23beaa705a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 150304bb-d8d1-4c08-93b6-fc07c69fd846] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:25.444540 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-99cae1fb-d799-4b2f-826c-2e23beaa705a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:25.445156 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-99cae1fb-d799-4b2f-826c-2e23beaa705a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:25.446089 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-99cae1fb-d799-4b2f-826c-2e23beaa705a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:25.446774 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-99cae1fb-d799-4b2f-826c-2e23beaa705a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:25.592804 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-99cae1fb-d799-4b2f-826c-2e23beaa705a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:25.601282 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-99cae1fb-d799-4b2f-826c-2e23beaa705a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846" status: 200 len: 1520 microversion: 2.1 time: 0.169645 May 04 19:08:25.602038 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 161/332] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:25 2022] GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:26.152929 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-578a8267-cfcd-4bd2-8934-7b7ca308770b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:26.153867 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-578a8267-cfcd-4bd2-8934-7b7ca308770b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:26.160215 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-578a8267-cfcd-4bd2-8934-7b7ca308770b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:26.160697 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-578a8267-cfcd-4bd2-8934-7b7ca308770b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:26.161845 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-578a8267-cfcd-4bd2-8934-7b7ca308770b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:26.162306 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-578a8267-cfcd-4bd2-8934-7b7ca308770b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:26.300663 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-578a8267-cfcd-4bd2-8934-7b7ca308770b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:26.310930 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-578a8267-cfcd-4bd2-8934-7b7ca308770b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1721 microversion: 2.1 time: 0.162400 May 04 19:08:26.321862 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 172/333] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:26 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:26.356556 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-4d1e11c2-cda6-4570-a79a-8440a4aaa368 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:26.357171 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-4d1e11c2-cda6-4570-a79a-8440a4aaa368 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:26.364507 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4d1e11c2-cda6-4570-a79a-8440a4aaa368 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:26.364994 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4d1e11c2-cda6-4570-a79a-8440a4aaa368 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:26.365810 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4d1e11c2-cda6-4570-a79a-8440a4aaa368 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:26.366434 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4d1e11c2-cda6-4570-a79a-8440a4aaa368 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:26.513774 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-4d1e11c2-cda6-4570-a79a-8440a4aaa368 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:26.523031 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-4d1e11c2-cda6-4570-a79a-8440a4aaa368 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:26.524976 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-4d1e11c2-cda6-4570-a79a-8440a4aaa368 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:26.527156 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-4d1e11c2-cda6-4570-a79a-8440a4aaa368 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1745 microversion: 2.20 time: 0.174633 May 04 19:08:26.528614 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 162/334] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:08:26 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1745 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 04 19:08:26.623763 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-55a781d1-7f8c-4abf-b314-e726eee0cda6 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:26.624695 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-55a781d1-7f8c-4abf-b314-e726eee0cda6 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 150304bb-d8d1-4c08-93b6-fc07c69fd846] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:26.646974 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-55a781d1-7f8c-4abf-b314-e726eee0cda6 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:26.647546 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-55a781d1-7f8c-4abf-b314-e726eee0cda6 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:26.648545 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-55a781d1-7f8c-4abf-b314-e726eee0cda6 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:26.649139 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-55a781d1-7f8c-4abf-b314-e726eee0cda6 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:26.815205 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-e27eda30-d25e-41a9-82ca-b5a2202e457d req-a44dbde3-befa-4b0f-825e-cf2f4ff57768 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f929e9e-51bf-477a-877b-6c162202c7f5", "name": "network-vif-plugged", "status": "completed", "tag": "c2916343-9825-41ef-93c5-4b2dbc6d65a9"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:08:26.819868 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-55a781d1-7f8c-4abf-b314-e726eee0cda6 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:26.828069 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-e27eda30-d25e-41a9-82ca-b5a2202e457d req-a44dbde3-befa-4b0f-825e-cf2f4ff57768 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:26.828517 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-e27eda30-d25e-41a9-82ca-b5a2202e457d req-a44dbde3-befa-4b0f-825e-cf2f4ff57768 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:26.833271 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-55a781d1-7f8c-4abf-b314-e726eee0cda6 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846" status: 200 len: 1520 microversion: 2.1 time: 0.217238 May 04 19:08:26.834034 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 173/335] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:26 2022] GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846 => generated 1520 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:26.850879 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-e27eda30-d25e-41a9-82ca-b5a2202e457d req-a44dbde3-befa-4b0f-825e-cf2f4ff57768 service nova] Creating event network-vif-plugged:c2916343-9825-41ef-93c5-4b2dbc6d65a9 for instance 8f929e9e-51bf-477a-877b-6c162202c7f5 on hv-cinder-83090 May 04 19:08:26.882737 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-e27eda30-d25e-41a9-82ca-b5a2202e457d req-a44dbde3-befa-4b0f-825e-cf2f4ff57768 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071164 May 04 19:08:26.883379 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 163/336] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 04 19:08:27.330135 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-20753044-f92f-4fe8-8794-c55457ef14b9 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:27.331579 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-20753044-f92f-4fe8-8794-c55457ef14b9 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:27.338541 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-20753044-f92f-4fe8-8794-c55457ef14b9 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:27.338992 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-20753044-f92f-4fe8-8794-c55457ef14b9 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:27.340111 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-20753044-f92f-4fe8-8794-c55457ef14b9 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:27.340553 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-20753044-f92f-4fe8-8794-c55457ef14b9 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:27.480591 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-20753044-f92f-4fe8-8794-c55457ef14b9 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:27.489937 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-20753044-f92f-4fe8-8794-c55457ef14b9 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1721 microversion: 2.1 time: 0.164092 May 04 19:08:27.490580 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 174/337] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:27 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:27.550318 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-3f8cdf9a-d2d3-4aa1-8bd3-b96db7bcb2f5 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:27.552798 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-3f8cdf9a-d2d3-4aa1-8bd3-b96db7bcb2f5 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:27.563846 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3f8cdf9a-d2d3-4aa1-8bd3-b96db7bcb2f5 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:27.564478 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3f8cdf9a-d2d3-4aa1-8bd3-b96db7bcb2f5 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:27.565239 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3f8cdf9a-d2d3-4aa1-8bd3-b96db7bcb2f5 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:27.565694 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3f8cdf9a-d2d3-4aa1-8bd3-b96db7bcb2f5 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:27.712374 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-3f8cdf9a-d2d3-4aa1-8bd3-b96db7bcb2f5 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:27.722695 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-3f8cdf9a-d2d3-4aa1-8bd3-b96db7bcb2f5 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:27.724639 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-3f8cdf9a-d2d3-4aa1-8bd3-b96db7bcb2f5 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:27.726759 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-3f8cdf9a-d2d3-4aa1-8bd3-b96db7bcb2f5 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1745 microversion: 2.20 time: 0.182865 May 04 19:08:27.727773 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 164/338] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:08:27 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1745 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:08:27.852968 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-3b115759-f6cb-466a-ad4e-da2a7a029f17 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:27.854393 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-3b115759-f6cb-466a-ad4e-da2a7a029f17 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 150304bb-d8d1-4c08-93b6-fc07c69fd846] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:27.861831 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3b115759-f6cb-466a-ad4e-da2a7a029f17 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:27.863005 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3b115759-f6cb-466a-ad4e-da2a7a029f17 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:27.864253 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3b115759-f6cb-466a-ad4e-da2a7a029f17 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:27.865085 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3b115759-f6cb-466a-ad4e-da2a7a029f17 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:28.025910 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-3b115759-f6cb-466a-ad4e-da2a7a029f17 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:28.033185 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-3b115759-f6cb-466a-ad4e-da2a7a029f17 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846" status: 200 len: 1520 microversion: 2.1 time: 0.185767 May 04 19:08:28.033981 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 175/339] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:27 2022] GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846 => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:28.509342 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-2b2367d7-1d62-46b6-9333-2a4838623527 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:28.509983 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-2b2367d7-1d62-46b6-9333-2a4838623527 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:28.516381 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2b2367d7-1d62-46b6-9333-2a4838623527 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:28.516835 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2b2367d7-1d62-46b6-9333-2a4838623527 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:28.518032 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2b2367d7-1d62-46b6-9333-2a4838623527 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:28.518449 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2b2367d7-1d62-46b6-9333-2a4838623527 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:28.662361 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-2b2367d7-1d62-46b6-9333-2a4838623527 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:28.671321 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-2b2367d7-1d62-46b6-9333-2a4838623527 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1721 microversion: 2.1 time: 0.166722 May 04 19:08:28.681792 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 165/340] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:28 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:28.746112 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-b74a56a7-6634-48b3-a668-c6b94257bef5 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:28.746839 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-b74a56a7-6634-48b3-a668-c6b94257bef5 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:28.753135 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b74a56a7-6634-48b3-a668-c6b94257bef5 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:28.753708 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b74a56a7-6634-48b3-a668-c6b94257bef5 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:28.754548 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b74a56a7-6634-48b3-a668-c6b94257bef5 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:28.755210 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b74a56a7-6634-48b3-a668-c6b94257bef5 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:28.896832 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-b74a56a7-6634-48b3-a668-c6b94257bef5 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:28.905839 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-b74a56a7-6634-48b3-a668-c6b94257bef5 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:28.907451 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-b74a56a7-6634-48b3-a668-c6b94257bef5 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:28.908685 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-b74a56a7-6634-48b3-a668-c6b94257bef5 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1740 microversion: 2.20 time: 0.167231 May 04 19:08:28.909274 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 176/341] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:08:28 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1740 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:08:29.050351 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-202f6ba0-2f61-44bf-a5af-1604797e4369 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:29.051776 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-202f6ba0-2f61-44bf-a5af-1604797e4369 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 150304bb-d8d1-4c08-93b6-fc07c69fd846] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:29.062146 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-202f6ba0-2f61-44bf-a5af-1604797e4369 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:29.063351 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-202f6ba0-2f61-44bf-a5af-1604797e4369 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:29.064204 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-202f6ba0-2f61-44bf-a5af-1604797e4369 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:29.064730 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-202f6ba0-2f61-44bf-a5af-1604797e4369 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:29.230964 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-202f6ba0-2f61-44bf-a5af-1604797e4369 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:29.240825 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-202f6ba0-2f61-44bf-a5af-1604797e4369 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846" status: 200 len: 1520 microversion: 2.1 time: 0.194242 May 04 19:08:29.241553 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 166/342] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:29 2022] GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846 => generated 1520 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:29.689175 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-b8aa181c-503d-4cfc-8be3-929cf272f115 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:29.689858 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-b8aa181c-503d-4cfc-8be3-929cf272f115 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:29.696814 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b8aa181c-503d-4cfc-8be3-929cf272f115 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:29.697272 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b8aa181c-503d-4cfc-8be3-929cf272f115 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:29.698118 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b8aa181c-503d-4cfc-8be3-929cf272f115 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:29.698561 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b8aa181c-503d-4cfc-8be3-929cf272f115 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:29.840585 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-b8aa181c-503d-4cfc-8be3-929cf272f115 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:29.848669 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-b8aa181c-503d-4cfc-8be3-929cf272f115 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1721 microversion: 2.1 time: 0.163852 May 04 19:08:29.857192 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 177/343] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:29 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:08:29.931006 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-d10fda52-6e26-4ee4-9ce7-520fa7c01e39 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:29.931683 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-d10fda52-6e26-4ee4-9ce7-520fa7c01e39 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:29.941413 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d10fda52-6e26-4ee4-9ce7-520fa7c01e39 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:29.941890 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d10fda52-6e26-4ee4-9ce7-520fa7c01e39 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:29.942704 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d10fda52-6e26-4ee4-9ce7-520fa7c01e39 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:29.943139 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d10fda52-6e26-4ee4-9ce7-520fa7c01e39 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:30.155745 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-d10fda52-6e26-4ee4-9ce7-520fa7c01e39 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:30.164712 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-d10fda52-6e26-4ee4-9ce7-520fa7c01e39 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:30.166488 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-d10fda52-6e26-4ee4-9ce7-520fa7c01e39 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:30.167697 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-d10fda52-6e26-4ee4-9ce7-520fa7c01e39 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1740 microversion: 2.20 time: 0.244332 May 04 19:08:30.168482 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 167/344] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:08:29 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1740 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:08:30.263971 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-6040e36c-743a-45ad-8c27-4b64defbcc33 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:30.265273 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-6040e36c-743a-45ad-8c27-4b64defbcc33 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 150304bb-d8d1-4c08-93b6-fc07c69fd846] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:30.272647 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6040e36c-743a-45ad-8c27-4b64defbcc33 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:30.273244 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6040e36c-743a-45ad-8c27-4b64defbcc33 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:30.274277 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6040e36c-743a-45ad-8c27-4b64defbcc33 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:30.274755 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6040e36c-743a-45ad-8c27-4b64defbcc33 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:30.419947 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-6040e36c-743a-45ad-8c27-4b64defbcc33 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:30.427569 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-6040e36c-743a-45ad-8c27-4b64defbcc33 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846" status: 200 len: 1500 microversion: 2.1 time: 0.167802 May 04 19:08:30.430821 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 178/345] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:30 2022] GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846 => generated 1500 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:30.447853 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-1905c635-0f13-4651-8507-f1fe126517b5 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "05dc466d-b0fe-449e-a14c-6e1c31807c2a"}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:08:30.448998 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-1905c635-0f13-4651-8507-f1fe126517b5 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 150304bb-d8d1-4c08-93b6-fc07c69fd846] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:30.455563 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1905c635-0f13-4651-8507-f1fe126517b5 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:30.456021 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1905c635-0f13-4651-8507-f1fe126517b5 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:30.456794 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1905c635-0f13-4651-8507-f1fe126517b5 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:30.457233 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1905c635-0f13-4651-8507-f1fe126517b5 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:30.483958 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.wsgi [None req-1905c635-0f13-4651-8507-f1fe126517b5 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] HTTP exception thrown: Cannot 'attach_volume' instance 150304bb-d8d1-4c08-93b6-fc07c69fd846 while it is in vm_state rescued May 04 19:08:30.484562 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-1905c635-0f13-4651-8507-f1fe126517b5 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Returning 409 to user: Cannot 'attach_volume' instance 150304bb-d8d1-4c08-93b6-fc07c69fd846 while it is in vm_state rescued {{(pid=117125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 04 19:08:30.487105 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-1905c635-0f13-4651-8507-f1fe126517b5 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "POST /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042075 May 04 19:08:30.487827 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 168/346] 10.222.0.69 () {60 vars in 1322 bytes} [Wed May 4 19:08:30 2022] POST /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846/os-volume_attachments => generated 152 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 04 19:08:30.496468 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-75f6f135-e4e7-4414-bb81-b42cf08cf5f0 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:08:30.497006 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-75f6f135-e4e7-4414-bb81-b42cf08cf5f0 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 150304bb-d8d1-4c08-93b6-fc07c69fd846] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:30.504675 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-75f6f135-e4e7-4414-bb81-b42cf08cf5f0 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:30.517592 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-75f6f135-e4e7-4414-bb81-b42cf08cf5f0 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:30.519264 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-75f6f135-e4e7-4414-bb81-b42cf08cf5f0 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:30.519721 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-75f6f135-e4e7-4414-bb81-b42cf08cf5f0 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:30.620311 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-75f6f135-e4e7-4414-bb81-b42cf08cf5f0 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "POST /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846/action" status: 202 len: 0 microversion: 2.1 time: 0.127517 May 04 19:08:30.621506 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 179/347] 10.222.0.69 () {60 vars in 1277 bytes} [Wed May 4 19:08:30 2022] POST /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 04 19:08:30.631379 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-9c126136-169a-4065-a854-4e4e56964e6d tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:30.634405 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-9c126136-169a-4065-a854-4e4e56964e6d tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 150304bb-d8d1-4c08-93b6-fc07c69fd846] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:30.643636 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9c126136-169a-4065-a854-4e4e56964e6d tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:30.644557 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9c126136-169a-4065-a854-4e4e56964e6d tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:30.649277 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9c126136-169a-4065-a854-4e4e56964e6d tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:30.650920 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9c126136-169a-4065-a854-4e4e56964e6d tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:30.868138 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-e427173c-5a79-4704-8ba8-0b9434ad1578 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:30.868989 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-e427173c-5a79-4704-8ba8-0b9434ad1578 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:30.894476 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e427173c-5a79-4704-8ba8-0b9434ad1578 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:30.895850 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e427173c-5a79-4704-8ba8-0b9434ad1578 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:30.896679 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e427173c-5a79-4704-8ba8-0b9434ad1578 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:30.897156 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e427173c-5a79-4704-8ba8-0b9434ad1578 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:30.947076 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-9c126136-169a-4065-a854-4e4e56964e6d tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:30.955455 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-9c126136-169a-4065-a854-4e4e56964e6d tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846" status: 200 len: 1508 microversion: 2.1 time: 0.329053 May 04 19:08:30.969285 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 169/348] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:30 2022] GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846 => generated 1508 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:31.186450 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-590e4492-1019-4e20-8197-7d0f5769147c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:31.187484 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-590e4492-1019-4e20-8197-7d0f5769147c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:31.198750 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-590e4492-1019-4e20-8197-7d0f5769147c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:31.206089 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-590e4492-1019-4e20-8197-7d0f5769147c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:31.209660 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-590e4492-1019-4e20-8197-7d0f5769147c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:31.210310 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-590e4492-1019-4e20-8197-7d0f5769147c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:31.417948 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-e427173c-5a79-4704-8ba8-0b9434ad1578 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:31.427164 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-e427173c-5a79-4704-8ba8-0b9434ad1578 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1721 microversion: 2.1 time: 0.563420 May 04 19:08:31.440378 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 180/349] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:30 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1721 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:31.448176 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-590e4492-1019-4e20-8197-7d0f5769147c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:31.462894 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-590e4492-1019-4e20-8197-7d0f5769147c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:31.465039 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-590e4492-1019-4e20-8197-7d0f5769147c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:31.468798 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-590e4492-1019-4e20-8197-7d0f5769147c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1740 microversion: 2.20 time: 0.286189 May 04 19:08:31.469961 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 170/350] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:08:31 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1740 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 04 19:08:31.981438 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-5e0089d6-fe11-4db1-b5cb-016ddcc3a53c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:31.982658 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-5e0089d6-fe11-4db1-b5cb-016ddcc3a53c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 150304bb-d8d1-4c08-93b6-fc07c69fd846] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:31.996591 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5e0089d6-fe11-4db1-b5cb-016ddcc3a53c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:31.997782 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5e0089d6-fe11-4db1-b5cb-016ddcc3a53c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:32.000773 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5e0089d6-fe11-4db1-b5cb-016ddcc3a53c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:32.004772 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5e0089d6-fe11-4db1-b5cb-016ddcc3a53c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:32.271653 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-5e0089d6-fe11-4db1-b5cb-016ddcc3a53c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:32.284319 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-5e0089d6-fe11-4db1-b5cb-016ddcc3a53c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846" status: 200 len: 1508 microversion: 2.1 time: 0.313681 May 04 19:08:32.285613 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 181/351] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:31 2022] GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846 => generated 1508 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:32.449437 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-5b6a45ed-60ae-4e93-9f68-24dc7676d4dd tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:32.450036 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-5b6a45ed-60ae-4e93-9f68-24dc7676d4dd tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:32.486853 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-06b32ddc-03de-4cea-91df-fb20b5316aa1 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:32.487630 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-06b32ddc-03de-4cea-91df-fb20b5316aa1 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:32.499960 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-06b32ddc-03de-4cea-91df-fb20b5316aa1 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:32.500698 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-06b32ddc-03de-4cea-91df-fb20b5316aa1 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:32.503560 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5b6a45ed-60ae-4e93-9f68-24dc7676d4dd tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:32.504376 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-06b32ddc-03de-4cea-91df-fb20b5316aa1 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:32.504516 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5b6a45ed-60ae-4e93-9f68-24dc7676d4dd tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:32.509384 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5b6a45ed-60ae-4e93-9f68-24dc7676d4dd tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:32.511906 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-06b32ddc-03de-4cea-91df-fb20b5316aa1 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:32.522467 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5b6a45ed-60ae-4e93-9f68-24dc7676d4dd tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:32.753440 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-5b6a45ed-60ae-4e93-9f68-24dc7676d4dd tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:32.761821 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-5b6a45ed-60ae-4e93-9f68-24dc7676d4dd tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1721 microversion: 2.1 time: 0.317797 May 04 19:08:32.763896 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 171/352] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:32 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1721 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:32.944300 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-06b32ddc-03de-4cea-91df-fb20b5316aa1 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:32.969182 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-06b32ddc-03de-4cea-91df-fb20b5316aa1 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:32.971084 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-06b32ddc-03de-4cea-91df-fb20b5316aa1 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:32.972499 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-06b32ddc-03de-4cea-91df-fb20b5316aa1 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1740 microversion: 2.20 time: 0.489709 May 04 19:08:32.973250 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 182/353] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:08:32 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1740 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:08:33.303595 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-13b5bf3a-fd34-46cc-93f4-94763ad11f3a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:33.304358 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-13b5bf3a-fd34-46cc-93f4-94763ad11f3a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 150304bb-d8d1-4c08-93b6-fc07c69fd846] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:33.310793 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-13b5bf3a-fd34-46cc-93f4-94763ad11f3a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:33.311325 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-13b5bf3a-fd34-46cc-93f4-94763ad11f3a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:33.312189 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-13b5bf3a-fd34-46cc-93f4-94763ad11f3a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:33.312690 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-13b5bf3a-fd34-46cc-93f4-94763ad11f3a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:33.519246 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-13b5bf3a-fd34-46cc-93f4-94763ad11f3a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:33.528490 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-13b5bf3a-fd34-46cc-93f4-94763ad11f3a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846" status: 200 len: 1508 microversion: 2.1 time: 0.229437 May 04 19:08:33.549502 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 172/354] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:33 2022] GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846 => generated 1508 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:33.782012 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-98fb7ecd-3591-46d3-a2a2-53fc1501227e tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:33.783787 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-98fb7ecd-3591-46d3-a2a2-53fc1501227e tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:33.790818 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-98fb7ecd-3591-46d3-a2a2-53fc1501227e tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:33.791358 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-98fb7ecd-3591-46d3-a2a2-53fc1501227e tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:33.792216 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-98fb7ecd-3591-46d3-a2a2-53fc1501227e tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:33.792832 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-98fb7ecd-3591-46d3-a2a2-53fc1501227e tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:33.963660 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-98fb7ecd-3591-46d3-a2a2-53fc1501227e tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:33.973822 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-98fb7ecd-3591-46d3-a2a2-53fc1501227e tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1721 microversion: 2.1 time: 0.197202 May 04 19:08:33.975815 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 183/355] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:33 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1721 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:33.993679 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-e059c45d-f37d-4c98-91a3-9ccb476532c9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:33.994698 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-e059c45d-f37d-4c98-91a3-9ccb476532c9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:34.007869 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e059c45d-f37d-4c98-91a3-9ccb476532c9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:34.011099 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e059c45d-f37d-4c98-91a3-9ccb476532c9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:34.012782 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e059c45d-f37d-4c98-91a3-9ccb476532c9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:34.015379 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e059c45d-f37d-4c98-91a3-9ccb476532c9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:34.203468 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-e059c45d-f37d-4c98-91a3-9ccb476532c9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:34.217284 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-e059c45d-f37d-4c98-91a3-9ccb476532c9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:34.218763 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-e059c45d-f37d-4c98-91a3-9ccb476532c9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:34.219939 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-e059c45d-f37d-4c98-91a3-9ccb476532c9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1740 microversion: 2.20 time: 0.231598 May 04 19:08:34.238543 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 173/356] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:08:33 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1740 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:08:34.556745 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-0278ae7d-b078-4337-8a44-16256e60f47f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:34.557364 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-0278ae7d-b078-4337-8a44-16256e60f47f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 150304bb-d8d1-4c08-93b6-fc07c69fd846] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:34.565784 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0278ae7d-b078-4337-8a44-16256e60f47f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:34.566608 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0278ae7d-b078-4337-8a44-16256e60f47f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:34.567715 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0278ae7d-b078-4337-8a44-16256e60f47f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:34.568294 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0278ae7d-b078-4337-8a44-16256e60f47f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:34.753057 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-0278ae7d-b078-4337-8a44-16256e60f47f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:34.762390 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-0278ae7d-b078-4337-8a44-16256e60f47f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846" status: 200 len: 1508 microversion: 2.1 time: 0.210142 May 04 19:08:34.772611 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 184/357] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:34 2022] GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846 => generated 1508 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:34.992667 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-e092f009-ed5b-44cd-a4b9-bb6a08c85e39 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:34.994054 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-e092f009-ed5b-44cd-a4b9-bb6a08c85e39 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:35.006866 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e092f009-ed5b-44cd-a4b9-bb6a08c85e39 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:35.007988 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e092f009-ed5b-44cd-a4b9-bb6a08c85e39 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:35.009194 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e092f009-ed5b-44cd-a4b9-bb6a08c85e39 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:35.009912 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e092f009-ed5b-44cd-a4b9-bb6a08c85e39 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:35.243518 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-94d4bd67-d8be-477c-b825-b1426265b90c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:35.245093 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-94d4bd67-d8be-477c-b825-b1426265b90c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:35.256745 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-94d4bd67-d8be-477c-b825-b1426265b90c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:35.257655 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-94d4bd67-d8be-477c-b825-b1426265b90c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:35.260133 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-94d4bd67-d8be-477c-b825-b1426265b90c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:35.265212 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-94d4bd67-d8be-477c-b825-b1426265b90c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:35.292634 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-e092f009-ed5b-44cd-a4b9-bb6a08c85e39 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:35.308435 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-e092f009-ed5b-44cd-a4b9-bb6a08c85e39 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1721 microversion: 2.1 time: 0.318554 May 04 19:08:35.313499 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 174/358] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:34 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1721 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:35.463127 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-94d4bd67-d8be-477c-b825-b1426265b90c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:35.471438 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-94d4bd67-d8be-477c-b825-b1426265b90c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:35.474018 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-94d4bd67-d8be-477c-b825-b1426265b90c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:35.475473 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-94d4bd67-d8be-477c-b825-b1426265b90c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1740 microversion: 2.20 time: 0.236887 May 04 19:08:35.476639 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 185/359] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:08:35 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1740 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 04 19:08:35.783896 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-62f4963f-d8f7-4f16-8ea2-9c44f916f43c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:35.784994 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-62f4963f-d8f7-4f16-8ea2-9c44f916f43c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 150304bb-d8d1-4c08-93b6-fc07c69fd846] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:35.796278 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-62f4963f-d8f7-4f16-8ea2-9c44f916f43c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:35.797450 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-62f4963f-d8f7-4f16-8ea2-9c44f916f43c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:35.799109 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-62f4963f-d8f7-4f16-8ea2-9c44f916f43c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:35.799866 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-62f4963f-d8f7-4f16-8ea2-9c44f916f43c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:36.077601 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-62f4963f-d8f7-4f16-8ea2-9c44f916f43c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:36.088329 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-62f4963f-d8f7-4f16-8ea2-9c44f916f43c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846" status: 200 len: 1508 microversion: 2.1 time: 0.312001 May 04 19:08:36.098106 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 175/360] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:35 2022] GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846 => generated 1508 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:36.336388 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-03f6054c-5dff-45be-9968-aece4be190fb tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:36.337916 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-03f6054c-5dff-45be-9968-aece4be190fb tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:36.355558 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-03f6054c-5dff-45be-9968-aece4be190fb tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:36.356381 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-03f6054c-5dff-45be-9968-aece4be190fb tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:36.357503 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-03f6054c-5dff-45be-9968-aece4be190fb tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:36.358166 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-03f6054c-5dff-45be-9968-aece4be190fb tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:36.497002 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-475ecf4b-955e-4c29-b31b-b9136f16aefd tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:36.498054 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-475ecf4b-955e-4c29-b31b-b9136f16aefd tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:36.515215 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-475ecf4b-955e-4c29-b31b-b9136f16aefd tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:36.517954 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-475ecf4b-955e-4c29-b31b-b9136f16aefd tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:36.519256 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-475ecf4b-955e-4c29-b31b-b9136f16aefd tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:36.526941 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-475ecf4b-955e-4c29-b31b-b9136f16aefd tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:36.709864 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-03f6054c-5dff-45be-9968-aece4be190fb tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:36.722761 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-03f6054c-5dff-45be-9968-aece4be190fb tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1721 microversion: 2.1 time: 0.399822 May 04 19:08:36.733888 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 186/361] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:36 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1721 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:36.853190 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-475ecf4b-955e-4c29-b31b-b9136f16aefd tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:36.868130 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-475ecf4b-955e-4c29-b31b-b9136f16aefd tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:36.869802 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-475ecf4b-955e-4c29-b31b-b9136f16aefd tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:36.871168 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-475ecf4b-955e-4c29-b31b-b9136f16aefd tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1740 microversion: 2.20 time: 0.378765 May 04 19:08:36.886111 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 176/362] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:08:36 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1740 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 04 19:08:37.108119 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-4dcde344-390d-480f-94bb-08eac1135c47 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:37.108746 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-4dcde344-390d-480f-94bb-08eac1135c47 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 150304bb-d8d1-4c08-93b6-fc07c69fd846] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:37.120093 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4dcde344-390d-480f-94bb-08eac1135c47 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:37.120556 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4dcde344-390d-480f-94bb-08eac1135c47 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:37.121513 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4dcde344-390d-480f-94bb-08eac1135c47 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:37.121869 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4dcde344-390d-480f-94bb-08eac1135c47 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:37.307909 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-4dcde344-390d-480f-94bb-08eac1135c47 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:37.317020 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-4dcde344-390d-480f-94bb-08eac1135c47 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846" status: 200 len: 1508 microversion: 2.1 time: 0.214921 May 04 19:08:37.318914 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 187/363] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:37 2022] GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846 => generated 1508 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:37.740079 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-93df86eb-7e66-4dcb-b7b7-542dd2055978 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:37.740718 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-93df86eb-7e66-4dcb-b7b7-542dd2055978 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:37.751603 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-93df86eb-7e66-4dcb-b7b7-542dd2055978 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:37.752056 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-93df86eb-7e66-4dcb-b7b7-542dd2055978 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:37.752839 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-93df86eb-7e66-4dcb-b7b7-542dd2055978 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:37.753278 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-93df86eb-7e66-4dcb-b7b7-542dd2055978 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:37.890628 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-72150c91-02e2-4d9e-9861-ea24f2a27ee9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:37.892288 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-72150c91-02e2-4d9e-9861-ea24f2a27ee9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:37.899105 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-72150c91-02e2-4d9e-9861-ea24f2a27ee9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:37.899561 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-72150c91-02e2-4d9e-9861-ea24f2a27ee9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:37.900351 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-72150c91-02e2-4d9e-9861-ea24f2a27ee9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:37.900793 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-72150c91-02e2-4d9e-9861-ea24f2a27ee9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:37.912792 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-93df86eb-7e66-4dcb-b7b7-542dd2055978 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:37.934400 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-93df86eb-7e66-4dcb-b7b7-542dd2055978 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1721 microversion: 2.1 time: 0.186710 May 04 19:08:37.935635 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 177/364] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:37 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1721 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:38.042228 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-72150c91-02e2-4d9e-9861-ea24f2a27ee9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:38.052505 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-72150c91-02e2-4d9e-9861-ea24f2a27ee9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:38.055538 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-72150c91-02e2-4d9e-9861-ea24f2a27ee9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:38.056895 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-72150c91-02e2-4d9e-9861-ea24f2a27ee9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1740 microversion: 2.20 time: 0.170358 May 04 19:08:38.058266 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 188/365] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:08:37 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1740 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:08:38.341174 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-b5d03ae4-6a60-4918-a780-2db3f28f2178 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:38.341824 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-b5d03ae4-6a60-4918-a780-2db3f28f2178 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 150304bb-d8d1-4c08-93b6-fc07c69fd846] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:38.347822 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b5d03ae4-6a60-4918-a780-2db3f28f2178 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:38.348300 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b5d03ae4-6a60-4918-a780-2db3f28f2178 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:38.349060 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b5d03ae4-6a60-4918-a780-2db3f28f2178 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:38.349524 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b5d03ae4-6a60-4918-a780-2db3f28f2178 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:38.501421 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-b5d03ae4-6a60-4918-a780-2db3f28f2178 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:38.509683 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-b5d03ae4-6a60-4918-a780-2db3f28f2178 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846" status: 200 len: 1508 microversion: 2.1 time: 0.178008 May 04 19:08:38.512302 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 178/366] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:38 2022] GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846 => generated 1508 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:38.952733 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-fcdf8914-10f7-441a-90f0-7bb41c97833f tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:38.953379 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-fcdf8914-10f7-441a-90f0-7bb41c97833f tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:38.967257 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fcdf8914-10f7-441a-90f0-7bb41c97833f tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:38.967701 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fcdf8914-10f7-441a-90f0-7bb41c97833f tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:38.968479 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fcdf8914-10f7-441a-90f0-7bb41c97833f tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:38.968909 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fcdf8914-10f7-441a-90f0-7bb41c97833f tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:39.076523 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-77911dba-c600-4301-82b3-6f4c48ec99e4 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:39.077860 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-77911dba-c600-4301-82b3-6f4c48ec99e4 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:39.086405 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-77911dba-c600-4301-82b3-6f4c48ec99e4 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:39.087236 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-77911dba-c600-4301-82b3-6f4c48ec99e4 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:39.088252 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-77911dba-c600-4301-82b3-6f4c48ec99e4 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:39.089008 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-77911dba-c600-4301-82b3-6f4c48ec99e4 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:39.129901 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-fcdf8914-10f7-441a-90f0-7bb41c97833f tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:39.139211 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-fcdf8914-10f7-441a-90f0-7bb41c97833f tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1721 microversion: 2.1 time: 0.190298 May 04 19:08:39.150058 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 189/367] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:38 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1721 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:39.256809 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-77911dba-c600-4301-82b3-6f4c48ec99e4 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:39.266355 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-77911dba-c600-4301-82b3-6f4c48ec99e4 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:39.268197 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-77911dba-c600-4301-82b3-6f4c48ec99e4 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:39.269476 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-77911dba-c600-4301-82b3-6f4c48ec99e4 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1740 microversion: 2.20 time: 0.197135 May 04 19:08:39.273513 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 179/368] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:08:39 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1740 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:08:39.530324 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-63a0d9c8-285e-45d4-93be-767bc147648f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:39.531032 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-63a0d9c8-285e-45d4-93be-767bc147648f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 150304bb-d8d1-4c08-93b6-fc07c69fd846] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:39.537482 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-63a0d9c8-285e-45d4-93be-767bc147648f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:39.538020 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-63a0d9c8-285e-45d4-93be-767bc147648f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:39.538832 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-63a0d9c8-285e-45d4-93be-767bc147648f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:39.539274 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-63a0d9c8-285e-45d4-93be-767bc147648f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:39.689508 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-63a0d9c8-285e-45d4-93be-767bc147648f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:39.697399 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-63a0d9c8-285e-45d4-93be-767bc147648f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846" status: 200 len: 1508 microversion: 2.1 time: 0.171336 May 04 19:08:39.707647 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 190/369] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:39 2022] GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846 => generated 1508 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:40.156121 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-a763c244-1b29-41cf-81c4-1f2ee97e2c97 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:40.156821 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-a763c244-1b29-41cf-81c4-1f2ee97e2c97 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:40.163487 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a763c244-1b29-41cf-81c4-1f2ee97e2c97 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:40.163935 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a763c244-1b29-41cf-81c4-1f2ee97e2c97 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:40.164984 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a763c244-1b29-41cf-81c4-1f2ee97e2c97 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:40.165421 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a763c244-1b29-41cf-81c4-1f2ee97e2c97 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:40.288893 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-037c039a-1475-4156-aeda-08fcd41ab5a6 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:40.291944 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-037c039a-1475-4156-aeda-08fcd41ab5a6 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:40.301815 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-a763c244-1b29-41cf-81c4-1f2ee97e2c97 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:40.302987 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-037c039a-1475-4156-aeda-08fcd41ab5a6 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:40.303447 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-037c039a-1475-4156-aeda-08fcd41ab5a6 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:40.311926 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-a763c244-1b29-41cf-81c4-1f2ee97e2c97 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1721 microversion: 2.1 time: 0.159670 May 04 19:08:40.317142 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-037c039a-1475-4156-aeda-08fcd41ab5a6 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:40.317631 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-037c039a-1475-4156-aeda-08fcd41ab5a6 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:40.323746 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 180/370] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:40 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:40.497137 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-037c039a-1475-4156-aeda-08fcd41ab5a6 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:40.513964 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-037c039a-1475-4156-aeda-08fcd41ab5a6 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:40.515468 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-037c039a-1475-4156-aeda-08fcd41ab5a6 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:40.516684 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-037c039a-1475-4156-aeda-08fcd41ab5a6 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1740 microversion: 2.20 time: 0.232430 May 04 19:08:40.518758 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 191/371] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:08:40 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1740 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:08:40.715413 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-2f1d71b9-93e0-4a4a-926f-5454f5c87c5c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:40.716185 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-2f1d71b9-93e0-4a4a-926f-5454f5c87c5c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 150304bb-d8d1-4c08-93b6-fc07c69fd846] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:40.723343 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2f1d71b9-93e0-4a4a-926f-5454f5c87c5c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:40.723692 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2f1d71b9-93e0-4a4a-926f-5454f5c87c5c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:40.731435 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2f1d71b9-93e0-4a4a-926f-5454f5c87c5c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:40.731989 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2f1d71b9-93e0-4a4a-926f-5454f5c87c5c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:40.891044 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-2f1d71b9-93e0-4a4a-926f-5454f5c87c5c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:40.907605 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-2f1d71b9-93e0-4a4a-926f-5454f5c87c5c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846" status: 200 len: 1514 microversion: 2.1 time: 0.196205 May 04 19:08:40.923903 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 181/372] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:40 2022] GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846 => generated 1514 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:41.330346 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-61d75452-bbe9-4798-af2f-c511ba9ca96c tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:41.331034 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-61d75452-bbe9-4798-af2f-c511ba9ca96c tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:41.338416 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-61d75452-bbe9-4798-af2f-c511ba9ca96c tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:41.338916 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-61d75452-bbe9-4798-af2f-c511ba9ca96c tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:41.339862 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-61d75452-bbe9-4798-af2f-c511ba9ca96c tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:41.340291 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-61d75452-bbe9-4798-af2f-c511ba9ca96c tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:41.489109 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-61d75452-bbe9-4798-af2f-c511ba9ca96c tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:41.497486 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-61d75452-bbe9-4798-af2f-c511ba9ca96c tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1721 microversion: 2.1 time: 0.171476 May 04 19:08:41.498042 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 192/373] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:41 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:41.535030 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-2e53c0f9-e18b-47aa-b419-346a51310337 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:41.535634 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-2e53c0f9-e18b-47aa-b419-346a51310337 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:41.541978 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2e53c0f9-e18b-47aa-b419-346a51310337 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:41.542420 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2e53c0f9-e18b-47aa-b419-346a51310337 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:41.543181 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2e53c0f9-e18b-47aa-b419-346a51310337 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:41.543608 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2e53c0f9-e18b-47aa-b419-346a51310337 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:41.669212 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-2e53c0f9-e18b-47aa-b419-346a51310337 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:41.677233 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-2e53c0f9-e18b-47aa-b419-346a51310337 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:41.679267 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-2e53c0f9-e18b-47aa-b419-346a51310337 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:41.680436 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-2e53c0f9-e18b-47aa-b419-346a51310337 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1740 microversion: 2.20 time: 0.149288 May 04 19:08:41.680989 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 182/374] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:08:41 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1740 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:08:42.515560 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-646c0042-1da7-4db2-8ccd-013526080d9e tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:42.516188 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-646c0042-1da7-4db2-8ccd-013526080d9e tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:42.523527 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-646c0042-1da7-4db2-8ccd-013526080d9e tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:42.523916 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-646c0042-1da7-4db2-8ccd-013526080d9e tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:42.524681 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-646c0042-1da7-4db2-8ccd-013526080d9e tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:42.525119 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-646c0042-1da7-4db2-8ccd-013526080d9e tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:42.650529 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-646c0042-1da7-4db2-8ccd-013526080d9e tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:42.658122 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-646c0042-1da7-4db2-8ccd-013526080d9e tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1721 microversion: 2.1 time: 0.146411 May 04 19:08:42.658685 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 193/375] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:42 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1721 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:42.698612 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-d0547e64-a6fe-443d-9b3d-1753c8d5dca9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:42.699197 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-d0547e64-a6fe-443d-9b3d-1753c8d5dca9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:42.705487 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d0547e64-a6fe-443d-9b3d-1753c8d5dca9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:42.705930 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d0547e64-a6fe-443d-9b3d-1753c8d5dca9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:42.706676 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d0547e64-a6fe-443d-9b3d-1753c8d5dca9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:42.707103 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d0547e64-a6fe-443d-9b3d-1753c8d5dca9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:42.831259 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-d0547e64-a6fe-443d-9b3d-1753c8d5dca9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:42.839499 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-d0547e64-a6fe-443d-9b3d-1753c8d5dca9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:42.840981 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-d0547e64-a6fe-443d-9b3d-1753c8d5dca9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:42.842143 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-d0547e64-a6fe-443d-9b3d-1753c8d5dca9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1740 microversion: 2.20 time: 0.147844 May 04 19:08:42.842708 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 183/376] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:08:42 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1740 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:08:43.677605 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-cf1d4286-def1-40cc-ac34-63b09137c913 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:43.678131 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-cf1d4286-def1-40cc-ac34-63b09137c913 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:43.684094 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-cf1d4286-def1-40cc-ac34-63b09137c913 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:43.684539 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-cf1d4286-def1-40cc-ac34-63b09137c913 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:43.685294 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-cf1d4286-def1-40cc-ac34-63b09137c913 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:43.685750 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-cf1d4286-def1-40cc-ac34-63b09137c913 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:43.812939 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-cf1d4286-def1-40cc-ac34-63b09137c913 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:43.820635 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-cf1d4286-def1-40cc-ac34-63b09137c913 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1721 microversion: 2.1 time: 0.146951 May 04 19:08:43.821198 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 194/377] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:43 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1721 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:43.860174 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-7d964f88-3b11-4180-8943-74966fae9f46 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:43.860791 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-7d964f88-3b11-4180-8943-74966fae9f46 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:43.866823 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7d964f88-3b11-4180-8943-74966fae9f46 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:43.867262 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7d964f88-3b11-4180-8943-74966fae9f46 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:43.868008 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7d964f88-3b11-4180-8943-74966fae9f46 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:43.868465 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7d964f88-3b11-4180-8943-74966fae9f46 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:43.998457 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-7d964f88-3b11-4180-8943-74966fae9f46 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:44.006061 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-7d964f88-3b11-4180-8943-74966fae9f46 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:44.008063 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-7d964f88-3b11-4180-8943-74966fae9f46 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:44.009196 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-7d964f88-3b11-4180-8943-74966fae9f46 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1740 microversion: 2.20 time: 0.152922 May 04 19:08:44.009786 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 184/378] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:08:43 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1740 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:08:44.417855 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-c7368d90-cbfe-492e-b740-a5894c99b91f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Action: 'create', calling method: .version_select at 0x7fc3f75b2c10>, body: {"keypair": {"name": "tempest-keypair-828635571"}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:08:44.433244 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-c7368d90-cbfe-492e-b740-a5894c99b91f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Getting quotas for project 5966de1f7fc9403087d0ec08be6a3085. Resources: {'key_pairs'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 04 19:08:44.438137 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-c7368d90-cbfe-492e-b740-a5894c99b91f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Getting quotas for user 47deb39e5d954424a4fb4e97375443f7 and project 5966de1f7fc9403087d0ec08be6a3085. Resources: {'key_pairs'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 04 19:08:44.838201 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-07555035-7b50-4141-813e-66ee45edbecc tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:44.838949 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-07555035-7b50-4141-813e-66ee45edbecc tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:44.844903 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-07555035-7b50-4141-813e-66ee45edbecc tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:44.845415 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-07555035-7b50-4141-813e-66ee45edbecc tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:44.846315 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-07555035-7b50-4141-813e-66ee45edbecc tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:44.846830 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-07555035-7b50-4141-813e-66ee45edbecc tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:44.911380 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-c7368d90-cbfe-492e-b740-a5894c99b91f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Getting quotas for project 5966de1f7fc9403087d0ec08be6a3085. Resources: {'key_pairs'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 04 19:08:44.915275 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-c7368d90-cbfe-492e-b740-a5894c99b91f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Getting quotas for user 47deb39e5d954424a4fb4e97375443f7 and project 5966de1f7fc9403087d0ec08be6a3085. Resources: {'key_pairs'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 04 19:08:44.928608 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-c7368d90-cbfe-492e-b740-a5894c99b91f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.514407 May 04 19:08:44.929569 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 195/379] 10.222.0.69 () {60 vars in 1157 bytes} [Wed May 4 19:08:44 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:45.027987 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-07555035-7b50-4141-813e-66ee45edbecc tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:45.044174 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-ff859e59-b9a1-4873-8dca-e42fcd65e53c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:45.044812 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-ff859e59-b9a1-4873-8dca-e42fcd65e53c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:45.060472 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-07555035-7b50-4141-813e-66ee45edbecc tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1721 microversion: 2.1 time: 0.222551 May 04 19:08:45.061168 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 185/380] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:44 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1721 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:08:45.068116 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ff859e59-b9a1-4873-8dca-e42fcd65e53c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:45.071161 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ff859e59-b9a1-4873-8dca-e42fcd65e53c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:45.073680 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ff859e59-b9a1-4873-8dca-e42fcd65e53c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:45.077054 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ff859e59-b9a1-4873-8dca-e42fcd65e53c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:45.349408 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-ff859e59-b9a1-4873-8dca-e42fcd65e53c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:45.358131 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-ff859e59-b9a1-4873-8dca-e42fcd65e53c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:45.359873 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-ff859e59-b9a1-4873-8dca-e42fcd65e53c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:45.361051 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-ff859e59-b9a1-4873-8dca-e42fcd65e53c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1722 microversion: 2.20 time: 0.329169 May 04 19:08:45.362107 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 196/381] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:08:45 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1722 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:08:46.078974 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-83d1ecf9-156a-4c4a-82a1-fe9b512de177 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:46.080740 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-83d1ecf9-156a-4c4a-82a1-fe9b512de177 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:46.089126 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-83d1ecf9-156a-4c4a-82a1-fe9b512de177 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:46.089972 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-83d1ecf9-156a-4c4a-82a1-fe9b512de177 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:46.091060 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-83d1ecf9-156a-4c4a-82a1-fe9b512de177 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:46.091846 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-83d1ecf9-156a-4c4a-82a1-fe9b512de177 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:46.233360 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-83d1ecf9-156a-4c4a-82a1-fe9b512de177 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:46.243488 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-83d1ecf9-156a-4c4a-82a1-fe9b512de177 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1698 microversion: 2.1 time: 0.168972 May 04 19:08:46.244085 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 186/382] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:46 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1698 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:46.261390 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-22a46951-b13b-46fb-b7e8-414d1882631c tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:08:46.268779 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-22a46951-b13b-46fb-b7e8-414d1882631c tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:46.269495 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-22a46951-b13b-46fb-b7e8-414d1882631c tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:46.292749 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-22a46951-b13b-46fb-b7e8-414d1882631c tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Going to try to start instance {{(pid=117124) start /opt/stack/nova/nova/compute/api.py:2730}} May 04 19:08:46.343764 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-22a46951-b13b-46fb-b7e8-414d1882631c tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "POST /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d/action" status: 202 len: 0 microversion: 2.1 time: 0.086876 May 04 19:08:46.349868 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 197/383] 10.222.0.69 () {60 vars in 1277 bytes} [Wed May 4 19:08:46 2022] POST /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 04 19:08:46.358448 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-05e19a14-9ceb-496e-b4a3-314706152cdb tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:46.359153 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-05e19a14-9ceb-496e-b4a3-314706152cdb tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:46.365310 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-05e19a14-9ceb-496e-b4a3-314706152cdb tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:46.365793 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-05e19a14-9ceb-496e-b4a3-314706152cdb tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:46.366655 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-05e19a14-9ceb-496e-b4a3-314706152cdb tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:46.367269 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-05e19a14-9ceb-496e-b4a3-314706152cdb tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:46.380808 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-a9a20a59-6c8d-4cc5-a794-7fd291212bdf tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:46.382497 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-a9a20a59-6c8d-4cc5-a794-7fd291212bdf tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:46.389519 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a9a20a59-6c8d-4cc5-a794-7fd291212bdf tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:46.390448 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a9a20a59-6c8d-4cc5-a794-7fd291212bdf tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:46.391502 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a9a20a59-6c8d-4cc5-a794-7fd291212bdf tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:46.392400 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a9a20a59-6c8d-4cc5-a794-7fd291212bdf tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:46.505755 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-05e19a14-9ceb-496e-b4a3-314706152cdb tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:46.515127 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-05e19a14-9ceb-496e-b4a3-314706152cdb tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1707 microversion: 2.1 time: 0.160806 May 04 19:08:46.515701 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 187/384] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:46 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1707 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:46.579419 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-a9a20a59-6c8d-4cc5-a794-7fd291212bdf tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:46.588429 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-a9a20a59-6c8d-4cc5-a794-7fd291212bdf tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:46.589956 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-a9a20a59-6c8d-4cc5-a794-7fd291212bdf tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:46.591195 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-a9a20a59-6c8d-4cc5-a794-7fd291212bdf tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1722 microversion: 2.20 time: 0.214539 May 04 19:08:46.602740 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 198/385] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:08:46 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1722 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 04 19:08:46.790852 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-f4d2ee75-a751-4e53-ad6c-72c14fe27d4d tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1552765606", "imageRef": "2869595e-cda4-45af-aaeb-0779eb5f4114", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f77ad9c5-1b1c-436b-b024-d2a34457a300"}], "security_groups": [{"name": "tempest-securitygroup--833944136"}], "key_name": "tempest-keypair-828635571", "user_data": "}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:08:46.892719 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.network.neutron [None req-f4d2ee75-a751-4e53-ad6c-72c14fe27d4d tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] validate_networks() for [('f77ad9c5-1b1c-436b-b024-d2a34457a300', None, None, None, None, None)] {{(pid=117125) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 04 19:08:47.255206 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-f4d2ee75-a751-4e53-ad6c-72c14fe27d4d tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Flavor limits 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 04 19:08:47.255699 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-f4d2ee75-a751-4e53-ad6c-72c14fe27d4d tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Image limits 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 04 19:08:47.256085 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-f4d2ee75-a751-4e53-ad6c-72c14fe27d4d tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Flavor pref 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 04 19:08:47.256516 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-f4d2ee75-a751-4e53-ad6c-72c14fe27d4d tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Image pref 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 04 19:08:47.257419 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-f4d2ee75-a751-4e53-ad6c-72c14fe27d4d tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 04 19:08:47.265973 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f4d2ee75-a751-4e53-ad6c-72c14fe27d4d tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:47.266418 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f4d2ee75-a751-4e53-ad6c-72c14fe27d4d tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:47.267467 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f4d2ee75-a751-4e53-ad6c-72c14fe27d4d tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:47.267908 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f4d2ee75-a751-4e53-ad6c-72c14fe27d4d tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:47.284397 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-f4d2ee75-a751-4e53-ad6c-72c14fe27d4d tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Getting quotas for project 5966de1f7fc9403087d0ec08be6a3085. Resources: {'cores', 'ram', 'instances'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 04 19:08:47.288254 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-f4d2ee75-a751-4e53-ad6c-72c14fe27d4d tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Getting quotas for user 47deb39e5d954424a4fb4e97375443f7 and project 5966de1f7fc9403087d0ec08be6a3085. Resources: {'cores', 'ram', 'instances'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 04 19:08:47.298820 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-f4d2ee75-a751-4e53-ad6c-72c14fe27d4d tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Going to run 1 instances... {{(pid=117125) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 04 19:08:47.301016 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-f4d2ee75-a751-4e53-ad6c-72c14fe27d4d tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2869595e-cda4-45af-aaeb-0779eb5f4114',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 04 19:08:47.346134 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-f4d2ee75-a751-4e53-ad6c-72c14fe27d4d tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.560479 May 04 19:08:47.346779 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 188/386] 10.222.0.69 () {60 vars in 1146 bytes} [Wed May 4 19:08:46 2022] POST /compute/v2.1/servers => generated 408 bytes in 562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 04 19:08:47.356629 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-c2fefe74-eb40-4fe2-bc24-bd40025bc20b tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:47.357236 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-c2fefe74-eb40-4fe2-bc24-bd40025bc20b tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:47.411897 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-c2fefe74-eb40-4fe2-bc24-bd40025bc20b tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:47.418423 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-c2fefe74-eb40-4fe2-bc24-bd40025bc20b tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 200 len: 1245 microversion: 2.1 time: 0.065549 May 04 19:08:47.418935 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 199/387] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:47 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 1245 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:47.534961 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-8ad14ba8-8363-4153-a93c-e29683ab48d1 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:47.535933 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-8ad14ba8-8363-4153-a93c-e29683ab48d1 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:47.542725 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8ad14ba8-8363-4153-a93c-e29683ab48d1 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:47.543174 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8ad14ba8-8363-4153-a93c-e29683ab48d1 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:47.543934 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8ad14ba8-8363-4153-a93c-e29683ab48d1 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:47.544368 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8ad14ba8-8363-4153-a93c-e29683ab48d1 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:47.609747 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-181a9de0-b5e0-4c9f-9c10-0d1f85b85de6 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:47.611077 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-181a9de0-b5e0-4c9f-9c10-0d1f85b85de6 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:47.620444 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-181a9de0-b5e0-4c9f-9c10-0d1f85b85de6 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:47.621218 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-181a9de0-b5e0-4c9f-9c10-0d1f85b85de6 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:47.622131 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-181a9de0-b5e0-4c9f-9c10-0d1f85b85de6 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:47.622681 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-181a9de0-b5e0-4c9f-9c10-0d1f85b85de6 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:47.701616 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-8ad14ba8-8363-4153-a93c-e29683ab48d1 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:47.709610 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-8ad14ba8-8363-4153-a93c-e29683ab48d1 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1707 microversion: 2.1 time: 0.180333 May 04 19:08:47.720445 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 189/388] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:47 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1707 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:47.773998 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-181a9de0-b5e0-4c9f-9c10-0d1f85b85de6 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:47.782560 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-181a9de0-b5e0-4c9f-9c10-0d1f85b85de6 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:47.784265 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-181a9de0-b5e0-4c9f-9c10-0d1f85b85de6 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:47.785542 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-181a9de0-b5e0-4c9f-9c10-0d1f85b85de6 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1722 microversion: 2.20 time: 0.179884 May 04 19:08:47.786184 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 200/389] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:08:47 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:08:48.071062 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-cc1f70af-ad6e-4f8c-b7b3-21ebc4a1ec02 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:48.071617 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-cc1f70af-ad6e-4f8c-b7b3-21ebc4a1ec02 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] [instance: 9d1266bd-77ec-4a0d-a557-71dafe7c5436] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:48.079033 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cc1f70af-ad6e-4f8c-b7b3-21ebc4a1ec02 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:48.079666 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cc1f70af-ad6e-4f8c-b7b3-21ebc4a1ec02 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:48.080529 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cc1f70af-ad6e-4f8c-b7b3-21ebc4a1ec02 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:48.081058 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cc1f70af-ad6e-4f8c-b7b3-21ebc4a1ec02 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:48.220627 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.objects.instance [None req-cc1f70af-ad6e-4f8c-b7b3-21ebc4a1ec02 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lazy-loading 'services' on Instance uuid 9d1266bd-77ec-4a0d-a557-71dafe7c5436 {{(pid=117125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 04 19:08:48.349113 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-cc1f70af-ad6e-4f8c-b7b3-21ebc4a1ec02 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] 10.222.0.69 "DELETE /compute/v2.1/servers/9d1266bd-77ec-4a0d-a557-71dafe7c5436/os-volume_attachments/f693a4bc-47e3-4711-918b-4dfe539fb20b" status: 202 len: 0 microversion: 2.1 time: 0.281236 May 04 19:08:48.349896 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 190/390] 10.222.0.69 () {58 vars in 1415 bytes} [Wed May 4 19:08:48 2022] DELETE /compute/v2.1/servers/9d1266bd-77ec-4a0d-a557-71dafe7c5436/os-volume_attachments/f693a4bc-47e3-4711-918b-4dfe539fb20b => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 04 19:08:48.435212 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-1be26762-b112-4d80-a642-1e789fd5929b tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:48.435822 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-1be26762-b112-4d80-a642-1e789fd5929b tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:48.442282 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1be26762-b112-4d80-a642-1e789fd5929b tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:48.442670 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1be26762-b112-4d80-a642-1e789fd5929b tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:48.443432 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1be26762-b112-4d80-a642-1e789fd5929b tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:48.443867 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1be26762-b112-4d80-a642-1e789fd5929b tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:48.507346 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-1be26762-b112-4d80-a642-1e789fd5929b tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:48.514654 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-1be26762-b112-4d80-a642-1e789fd5929b tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 200 len: 1297 microversion: 2.1 time: 0.083263 May 04 19:08:48.515215 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 201/391] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:48 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 1297 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:48.728269 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-970a4b49-bbe8-4ec8-b9a0-1e9428785601 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:48.729234 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-970a4b49-bbe8-4ec8-b9a0-1e9428785601 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:48.736091 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-970a4b49-bbe8-4ec8-b9a0-1e9428785601 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:48.736750 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-970a4b49-bbe8-4ec8-b9a0-1e9428785601 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:48.738245 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-970a4b49-bbe8-4ec8-b9a0-1e9428785601 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:48.738873 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-970a4b49-bbe8-4ec8-b9a0-1e9428785601 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:48.787513 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-d8475f89-4775-4016-82aa-d9524d757d64 req-83d74311-01dd-4399-9618-9a5aa37b12af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f929e9e-51bf-477a-877b-6c162202c7f5", "name": "network-vif-unplugged", "status": "completed", "tag": "c2916343-9825-41ef-93c5-4b2dbc6d65a9"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:08:48.796016 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-d8475f89-4775-4016-82aa-d9524d757d64 req-83d74311-01dd-4399-9618-9a5aa37b12af service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:48.796384 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-d8475f89-4775-4016-82aa-d9524d757d64 req-83d74311-01dd-4399-9618-9a5aa37b12af service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:48.809014 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-d8475f89-4775-4016-82aa-d9524d757d64 req-83d74311-01dd-4399-9618-9a5aa37b12af service nova] Creating event network-vif-unplugged:c2916343-9825-41ef-93c5-4b2dbc6d65a9 for instance 8f929e9e-51bf-477a-877b-6c162202c7f5 on hv-cinder-83090 May 04 19:08:48.814485 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-d8475f89-4775-4016-82aa-d9524d757d64 req-83d74311-01dd-4399-9618-9a5aa37b12af service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030688 May 04 19:08:48.815085 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 202/392] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 04 19:08:48.820661 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-644726d3-8bf8-4110-91da-cf0012c348eb tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:48.821410 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-644726d3-8bf8-4110-91da-cf0012c348eb tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:48.828720 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-644726d3-8bf8-4110-91da-cf0012c348eb tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:48.829173 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-644726d3-8bf8-4110-91da-cf0012c348eb tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:48.829972 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-644726d3-8bf8-4110-91da-cf0012c348eb tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:48.830403 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-644726d3-8bf8-4110-91da-cf0012c348eb tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:48.875276 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-970a4b49-bbe8-4ec8-b9a0-1e9428785601 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:48.884012 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-970a4b49-bbe8-4ec8-b9a0-1e9428785601 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1707 microversion: 2.1 time: 0.160173 May 04 19:08:48.884597 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 191/393] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:48 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1707 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:48.968248 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-644726d3-8bf8-4110-91da-cf0012c348eb tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:48.976093 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-644726d3-8bf8-4110-91da-cf0012c348eb tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:48.977618 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-644726d3-8bf8-4110-91da-cf0012c348eb tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:48.978778 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-644726d3-8bf8-4110-91da-cf0012c348eb tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1725 microversion: 2.20 time: 0.162545 May 04 19:08:48.979341 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 203/394] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:08:48 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:08:48.996644 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-76a12573-867f-4568-93f3-31d0a6b69c34 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3e15e307-0447-43a6-ad66-e1714ddcae37"}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:08:48.997814 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-76a12573-867f-4568-93f3-31d0a6b69c34 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:49.004085 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-76a12573-867f-4568-93f3-31d0a6b69c34 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:49.004522 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-76a12573-867f-4568-93f3-31d0a6b69c34 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:49.005288 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-76a12573-867f-4568-93f3-31d0a6b69c34 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:49.005762 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-76a12573-867f-4568-93f3-31d0a6b69c34 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:49.392222 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-76a12573-867f-4568-93f3-31d0a6b69c34 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "POST /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.399191 May 04 19:08:49.397514 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 192/395] 10.222.0.69 () {62 vars in 1363 bytes} [Wed May 4 19:08:48 2022] POST /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5/os-volume_attachments => generated 188 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 04 19:08:49.508779 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-ddd5e786-4150-4909-bc33-804479512640 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:08:49.509394 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-ddd5e786-4150-4909-bc33-804479512640 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:49.516155 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ddd5e786-4150-4909-bc33-804479512640 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:49.516603 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ddd5e786-4150-4909-bc33-804479512640 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:49.517651 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ddd5e786-4150-4909-bc33-804479512640 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:49.518084 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ddd5e786-4150-4909-bc33-804479512640 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:49.533652 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-b1622e63-4b8b-4129-8a76-b1f0da0b63e8 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:49.534389 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-b1622e63-4b8b-4129-8a76-b1f0da0b63e8 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:49.541605 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b1622e63-4b8b-4129-8a76-b1f0da0b63e8 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:49.542138 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b1622e63-4b8b-4129-8a76-b1f0da0b63e8 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:49.543019 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b1622e63-4b8b-4129-8a76-b1f0da0b63e8 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:49.543693 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b1622e63-4b8b-4129-8a76-b1f0da0b63e8 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:49.617591 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-ddd5e786-4150-4909-bc33-804479512640 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "POST /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5/action" status: 202 len: 0 microversion: 2.20 time: 0.112709 May 04 19:08:49.618368 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 204/396] 10.222.0.69 () {62 vars in 1318 bytes} [Wed May 4 19:08:49 2022] POST /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 04 19:08:49.623876 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-b1622e63-4b8b-4129-8a76-b1f0da0b63e8 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:49.626990 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-43c5ec6b-0d9a-4e9e-9970-89b7fc477d63 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:49.627797 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-43c5ec6b-0d9a-4e9e-9970-89b7fc477d63 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:49.634958 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-43c5ec6b-0d9a-4e9e-9970-89b7fc477d63 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:49.636766 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-43c5ec6b-0d9a-4e9e-9970-89b7fc477d63 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:49.637812 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-43c5ec6b-0d9a-4e9e-9970-89b7fc477d63 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:49.638253 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-43c5ec6b-0d9a-4e9e-9970-89b7fc477d63 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:49.639981 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-b1622e63-4b8b-4129-8a76-b1f0da0b63e8 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 200 len: 1303 microversion: 2.1 time: 0.110183 May 04 19:08:49.649170 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 193/397] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:49 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 1303 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:49.902458 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-52bff300-bc12-43be-bfb0-537a6f538c9b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:49.902809 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-52bff300-bc12-43be-bfb0-537a6f538c9b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:49.909186 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-52bff300-bc12-43be-bfb0-537a6f538c9b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:49.909661 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-52bff300-bc12-43be-bfb0-537a6f538c9b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:49.910631 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-52bff300-bc12-43be-bfb0-537a6f538c9b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:49.911061 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-52bff300-bc12-43be-bfb0-537a6f538c9b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:49.947276 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-43c5ec6b-0d9a-4e9e-9970-89b7fc477d63 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:49.958702 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-43c5ec6b-0d9a-4e9e-9970-89b7fc477d63 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:49.961097 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-43c5ec6b-0d9a-4e9e-9970-89b7fc477d63 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:49.962529 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-43c5ec6b-0d9a-4e9e-9970-89b7fc477d63 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1751 microversion: 2.20 time: 0.339500 May 04 19:08:49.974100 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 205/398] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:08:49 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1751 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:08:50.094583 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-52bff300-bc12-43be-bfb0-537a6f538c9b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:50.102645 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-52bff300-bc12-43be-bfb0-537a6f538c9b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1707 microversion: 2.1 time: 0.204437 May 04 19:08:50.104679 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 194/399] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:49 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1707 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:08:50.523467 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-1b59b1a3-fc76-45e6-965f-e0406e913a69 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:50.523981 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-1b59b1a3-fc76-45e6-965f-e0406e913a69 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] [instance: 9d1266bd-77ec-4a0d-a557-71dafe7c5436] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:50.529915 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1b59b1a3-fc76-45e6-965f-e0406e913a69 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:50.530573 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1b59b1a3-fc76-45e6-965f-e0406e913a69 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:50.531352 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1b59b1a3-fc76-45e6-965f-e0406e913a69 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:50.531793 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1b59b1a3-fc76-45e6-965f-e0406e913a69 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:50.559273 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-1b59b1a3-fc76-45e6-965f-e0406e913a69 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] [instance: 9d1266bd-77ec-4a0d-a557-71dafe7c5436] Going to try to terminate instance {{(pid=117124) delete /opt/stack/nova/nova/compute/api.py:2664}} May 04 19:08:50.660077 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-37e38cab-2662-4602-b7bc-1a24bf174e81 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:50.661702 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-37e38cab-2662-4602-b7bc-1a24bf174e81 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:50.668005 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-1b59b1a3-fc76-45e6-965f-e0406e913a69 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] 10.222.0.69 "DELETE /compute/v2.1/servers/9d1266bd-77ec-4a0d-a557-71dafe7c5436" status: 204 len: 0 microversion: 2.1 time: 0.147937 May 04 19:08:50.669671 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 206/400] 10.222.0.69 () {58 vars in 1238 bytes} [Wed May 4 19:08:50 2022] DELETE /compute/v2.1/servers/9d1266bd-77ec-4a0d-a557-71dafe7c5436 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 04 19:08:50.682039 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-37e38cab-2662-4602-b7bc-1a24bf174e81 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:50.682872 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-37e38cab-2662-4602-b7bc-1a24bf174e81 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:50.684398 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-37e38cab-2662-4602-b7bc-1a24bf174e81 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:50.687323 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-37e38cab-2662-4602-b7bc-1a24bf174e81 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:50.690048 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-cc1d778f-fb3c-4e7a-96a8-0ff60b6f7db2 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:50.694588 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-cc1d778f-fb3c-4e7a-96a8-0ff60b6f7db2 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] [instance: 9d1266bd-77ec-4a0d-a557-71dafe7c5436] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:50.702855 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-cc1d778f-fb3c-4e7a-96a8-0ff60b6f7db2 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:50.703315 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-cc1d778f-fb3c-4e7a-96a8-0ff60b6f7db2 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:50.704102 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-cc1d778f-fb3c-4e7a-96a8-0ff60b6f7db2 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:50.704544 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-cc1d778f-fb3c-4e7a-96a8-0ff60b6f7db2 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:50.857286 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-37e38cab-2662-4602-b7bc-1a24bf174e81 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:50.865215 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-37e38cab-2662-4602-b7bc-1a24bf174e81 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 200 len: 1370 microversion: 2.1 time: 0.210746 May 04 19:08:50.875737 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 195/401] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:50 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 1370 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:50.887840 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-cc1d778f-fb3c-4e7a-96a8-0ff60b6f7db2 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632af5ddc209419a93461afdb070fc87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedb3ef21b1e413395b1a4cdcfb3f4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:50.896636 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-cc1d778f-fb3c-4e7a-96a8-0ff60b6f7db2 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] 10.222.0.69 "GET /compute/v2.1/servers/9d1266bd-77ec-4a0d-a557-71dafe7c5436" status: 200 len: 1514 microversion: 2.1 time: 0.220465 May 04 19:08:50.897236 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 207/402] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:50 2022] GET /compute/v2.1/servers/9d1266bd-77ec-4a0d-a557-71dafe7c5436 => generated 1514 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:50.981247 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-1ab9074d-e255-4ec6-9daa-ab0eee58da15 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:50.982133 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-1ab9074d-e255-4ec6-9daa-ab0eee58da15 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:50.988154 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1ab9074d-e255-4ec6-9daa-ab0eee58da15 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:50.988609 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1ab9074d-e255-4ec6-9daa-ab0eee58da15 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:50.989381 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1ab9074d-e255-4ec6-9daa-ab0eee58da15 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:50.990010 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1ab9074d-e255-4ec6-9daa-ab0eee58da15 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:51.118748 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-1ab9074d-e255-4ec6-9daa-ab0eee58da15 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:51.121167 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-48f7bed6-b2cc-47a2-9e33-32bfac02cbc8 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:51.121806 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-48f7bed6-b2cc-47a2-9e33-32bfac02cbc8 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:51.127050 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-1ab9074d-e255-4ec6-9daa-ab0eee58da15 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:51.127737 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-48f7bed6-b2cc-47a2-9e33-32bfac02cbc8 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:51.128190 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-48f7bed6-b2cc-47a2-9e33-32bfac02cbc8 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:51.128788 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-1ab9074d-e255-4ec6-9daa-ab0eee58da15 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:51.128957 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-48f7bed6-b2cc-47a2-9e33-32bfac02cbc8 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:51.129397 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-48f7bed6-b2cc-47a2-9e33-32bfac02cbc8 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:51.130162 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-1ab9074d-e255-4ec6-9daa-ab0eee58da15 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1751 microversion: 2.20 time: 0.152871 May 04 19:08:51.130787 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 196/403] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:08:50 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:08:51.252587 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-48f7bed6-b2cc-47a2-9e33-32bfac02cbc8 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:51.260369 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-48f7bed6-b2cc-47a2-9e33-32bfac02cbc8 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1707 microversion: 2.1 time: 0.143042 May 04 19:08:51.260935 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 208/404] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:51 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1707 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:51.883321 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-1b4d5ab1-c4ed-4fc7-9418-61f1e2de113f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:51.883927 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-1b4d5ab1-c4ed-4fc7-9418-61f1e2de113f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:51.890409 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1b4d5ab1-c4ed-4fc7-9418-61f1e2de113f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:51.890875 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1b4d5ab1-c4ed-4fc7-9418-61f1e2de113f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:51.891635 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1b4d5ab1-c4ed-4fc7-9418-61f1e2de113f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:51.892319 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1b4d5ab1-c4ed-4fc7-9418-61f1e2de113f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:51.913725 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-4f7a98e9-e06e-4c59-9d86-4c6f587a53f7 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:51.914339 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-4f7a98e9-e06e-4c59-9d86-4c6f587a53f7 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] [instance: 9d1266bd-77ec-4a0d-a557-71dafe7c5436] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:51.920795 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4f7a98e9-e06e-4c59-9d86-4c6f587a53f7 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:51.921241 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4f7a98e9-e06e-4c59-9d86-4c6f587a53f7 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:51.922056 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4f7a98e9-e06e-4c59-9d86-4c6f587a53f7 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:51.922487 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4f7a98e9-e06e-4c59-9d86-4c6f587a53f7 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:52.020898 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-1b4d5ab1-c4ed-4fc7-9418-61f1e2de113f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:52.028200 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-1b4d5ab1-c4ed-4fc7-9418-61f1e2de113f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 200 len: 1370 microversion: 2.1 time: 0.149320 May 04 19:08:52.028767 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 197/405] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:51 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 1370 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:52.054111 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-4f7a98e9-e06e-4c59-9d86-4c6f587a53f7 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632af5ddc209419a93461afdb070fc87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedb3ef21b1e413395b1a4cdcfb3f4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:52.061248 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-4f7a98e9-e06e-4c59-9d86-4c6f587a53f7 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] 10.222.0.69 "GET /compute/v2.1/servers/9d1266bd-77ec-4a0d-a557-71dafe7c5436" status: 200 len: 1514 microversion: 2.1 time: 0.151476 May 04 19:08:52.062105 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 209/406] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:51 2022] GET /compute/v2.1/servers/9d1266bd-77ec-4a0d-a557-71dafe7c5436 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:08:52.149132 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-baa8bc49-1c7c-4a85-9d6a-3df0174e29d4 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:52.149705 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-baa8bc49-1c7c-4a85-9d6a-3df0174e29d4 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:52.155455 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-baa8bc49-1c7c-4a85-9d6a-3df0174e29d4 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:52.155893 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-baa8bc49-1c7c-4a85-9d6a-3df0174e29d4 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:52.156640 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-baa8bc49-1c7c-4a85-9d6a-3df0174e29d4 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:52.157069 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-baa8bc49-1c7c-4a85-9d6a-3df0174e29d4 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:52.277608 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-aaaccf66-76a0-42eb-9248-4e0bb863261b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:52.278214 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-aaaccf66-76a0-42eb-9248-4e0bb863261b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:52.279331 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-baa8bc49-1c7c-4a85-9d6a-3df0174e29d4 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:52.283963 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-aaaccf66-76a0-42eb-9248-4e0bb863261b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:52.284406 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-aaaccf66-76a0-42eb-9248-4e0bb863261b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:52.285162 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-aaaccf66-76a0-42eb-9248-4e0bb863261b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:52.285620 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-aaaccf66-76a0-42eb-9248-4e0bb863261b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:52.287476 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-baa8bc49-1c7c-4a85-9d6a-3df0174e29d4 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:52.289491 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-baa8bc49-1c7c-4a85-9d6a-3df0174e29d4 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:52.290700 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-baa8bc49-1c7c-4a85-9d6a-3df0174e29d4 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1751 microversion: 2.20 time: 0.145441 May 04 19:08:52.291267 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 198/407] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:08:52 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1751 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:08:52.409720 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-aaaccf66-76a0-42eb-9248-4e0bb863261b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:52.417981 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-aaaccf66-76a0-42eb-9248-4e0bb863261b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1707 microversion: 2.1 time: 0.144201 May 04 19:08:52.418666 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 210/408] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:52 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1707 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:08:53.044070 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-a064bca1-68e9-4456-95d1-6650c1fcbf60 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:53.044710 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-a064bca1-68e9-4456-95d1-6650c1fcbf60 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:53.052148 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a064bca1-68e9-4456-95d1-6650c1fcbf60 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:53.052598 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a064bca1-68e9-4456-95d1-6650c1fcbf60 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:53.053410 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a064bca1-68e9-4456-95d1-6650c1fcbf60 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:53.053873 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a064bca1-68e9-4456-95d1-6650c1fcbf60 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:53.078122 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-76e9abfc-79d5-4fa0-88e6-8055bcfdd0c3 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:53.078730 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-76e9abfc-79d5-4fa0-88e6-8055bcfdd0c3 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] [instance: 9d1266bd-77ec-4a0d-a557-71dafe7c5436] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:53.086532 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-76e9abfc-79d5-4fa0-88e6-8055bcfdd0c3 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:53.087222 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-76e9abfc-79d5-4fa0-88e6-8055bcfdd0c3 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:53.088231 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-76e9abfc-79d5-4fa0-88e6-8055bcfdd0c3 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:53.088860 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-76e9abfc-79d5-4fa0-88e6-8055bcfdd0c3 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:53.217548 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-a064bca1-68e9-4456-95d1-6650c1fcbf60 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:53.227372 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-a064bca1-68e9-4456-95d1-6650c1fcbf60 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 200 len: 1370 microversion: 2.1 time: 0.187123 May 04 19:08:53.227953 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 199/409] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:53 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 1370 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:53.291197 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-76e9abfc-79d5-4fa0-88e6-8055bcfdd0c3 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632af5ddc209419a93461afdb070fc87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedb3ef21b1e413395b1a4cdcfb3f4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:53.298540 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-76e9abfc-79d5-4fa0-88e6-8055bcfdd0c3 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] 10.222.0.69 "GET /compute/v2.1/servers/9d1266bd-77ec-4a0d-a557-71dafe7c5436" status: 200 len: 1514 microversion: 2.1 time: 0.224218 May 04 19:08:53.300046 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 211/410] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:53 2022] GET /compute/v2.1/servers/9d1266bd-77ec-4a0d-a557-71dafe7c5436 => generated 1514 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:53.313405 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-2e4a527b-2dde-4c41-ba4a-db22ec9b384d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:53.314031 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-2e4a527b-2dde-4c41-ba4a-db22ec9b384d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:53.320450 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2e4a527b-2dde-4c41-ba4a-db22ec9b384d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:53.320894 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2e4a527b-2dde-4c41-ba4a-db22ec9b384d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:53.321673 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2e4a527b-2dde-4c41-ba4a-db22ec9b384d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:53.322112 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2e4a527b-2dde-4c41-ba4a-db22ec9b384d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:53.440844 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-586dd89b-cbdd-40a2-be27-86471204742b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:53.441485 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-586dd89b-cbdd-40a2-be27-86471204742b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:53.450179 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-586dd89b-cbdd-40a2-be27-86471204742b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:53.450694 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-586dd89b-cbdd-40a2-be27-86471204742b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:53.451461 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-586dd89b-cbdd-40a2-be27-86471204742b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:53.451893 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-586dd89b-cbdd-40a2-be27-86471204742b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:53.457288 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-2e4a527b-2dde-4c41-ba4a-db22ec9b384d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:53.467312 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-2e4a527b-2dde-4c41-ba4a-db22ec9b384d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:53.468737 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-2e4a527b-2dde-4c41-ba4a-db22ec9b384d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:53.469939 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-2e4a527b-2dde-4c41-ba4a-db22ec9b384d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1751 microversion: 2.20 time: 0.160352 May 04 19:08:53.470873 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 200/411] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:08:53 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1751 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:08:53.657371 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-586dd89b-cbdd-40a2-be27-86471204742b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:53.665287 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-586dd89b-cbdd-40a2-be27-86471204742b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1711 microversion: 2.1 time: 0.232690 May 04 19:08:53.666004 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 212/412] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:53 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1711 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:53.725015 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-f293a2d6-eccd-4d3f-9c19-3d7200b30e01 req-c1cdd2a8-74e7-49cf-857b-4850afd08876 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17de0a81-ab42-475e-b6f3-dd853adc826c", "tag": "e11de5fb-b02b-4516-8fa9-a612b9b432a0"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:08:53.734418 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-f293a2d6-eccd-4d3f-9c19-3d7200b30e01 req-c1cdd2a8-74e7-49cf-857b-4850afd08876 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:53.735019 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-f293a2d6-eccd-4d3f-9c19-3d7200b30e01 req-c1cdd2a8-74e7-49cf-857b-4850afd08876 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:53.748030 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-f293a2d6-eccd-4d3f-9c19-3d7200b30e01 req-c1cdd2a8-74e7-49cf-857b-4850afd08876 service nova] Creating event network-changed:e11de5fb-b02b-4516-8fa9-a612b9b432a0 for instance 17de0a81-ab42-475e-b6f3-dd853adc826c on hv-cinder-83090 May 04 19:08:53.754459 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-f293a2d6-eccd-4d3f-9c19-3d7200b30e01 req-c1cdd2a8-74e7-49cf-857b-4850afd08876 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033343 May 04 19:08:53.755075 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 201/413] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:08:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:08:54.244229 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-ae243876-20e7-4e15-8298-8667e951a164 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:54.244872 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-ae243876-20e7-4e15-8298-8667e951a164 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:54.251277 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ae243876-20e7-4e15-8298-8667e951a164 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:54.251820 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ae243876-20e7-4e15-8298-8667e951a164 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:54.252595 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ae243876-20e7-4e15-8298-8667e951a164 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:54.253032 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ae243876-20e7-4e15-8298-8667e951a164 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:54.316679 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-77b9c54a-0eae-4667-bdaa-245f55b3988b tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:54.317373 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-77b9c54a-0eae-4667-bdaa-245f55b3988b tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] [instance: 9d1266bd-77ec-4a0d-a557-71dafe7c5436] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:54.324595 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-77b9c54a-0eae-4667-bdaa-245f55b3988b tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:54.325041 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-77b9c54a-0eae-4667-bdaa-245f55b3988b tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:54.325833 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-77b9c54a-0eae-4667-bdaa-245f55b3988b tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:54.326434 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-77b9c54a-0eae-4667-bdaa-245f55b3988b tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:54.472954 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-77b9c54a-0eae-4667-bdaa-245f55b3988b tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632af5ddc209419a93461afdb070fc87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedb3ef21b1e413395b1a4cdcfb3f4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:54.480776 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-77b9c54a-0eae-4667-bdaa-245f55b3988b tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] 10.222.0.69 "GET /compute/v2.1/servers/9d1266bd-77ec-4a0d-a557-71dafe7c5436" status: 200 len: 1514 microversion: 2.1 time: 0.168235 May 04 19:08:54.481746 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 202/414] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:54 2022] GET /compute/v2.1/servers/9d1266bd-77ec-4a0d-a557-71dafe7c5436 => generated 1514 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:08:54.495029 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-6797d550-5c29-49e0-b785-af2af815d5c3 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:54.495440 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-6797d550-5c29-49e0-b785-af2af815d5c3 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: fae4a97e-a910-4f71-abf2-8f62425c6a52] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:54.501909 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6797d550-5c29-49e0-b785-af2af815d5c3 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:54.502361 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6797d550-5c29-49e0-b785-af2af815d5c3 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:54.503129 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6797d550-5c29-49e0-b785-af2af815d5c3 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:54.503557 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6797d550-5c29-49e0-b785-af2af815d5c3 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:54.528636 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-6797d550-5c29-49e0-b785-af2af815d5c3 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/fae4a97e-a910-4f71-abf2-8f62425c6a52/ips" status: 200 len: 150 microversion: 2.1 time: 0.037678 May 04 19:08:54.529212 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 203/415] 10.222.0.69 () {58 vars in 1247 bytes} [Wed May 4 19:08:54 2022] GET /compute/v2.1/servers/fae4a97e-a910-4f71-abf2-8f62425c6a52/ips => generated 150 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:08:54.533538 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-607f714a-40d9-464d-a361-822f4fded5ce tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:54.534136 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-607f714a-40d9-464d-a361-822f4fded5ce tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:54.540251 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-607f714a-40d9-464d-a361-822f4fded5ce tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:54.540695 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-607f714a-40d9-464d-a361-822f4fded5ce tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:54.541482 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-607f714a-40d9-464d-a361-822f4fded5ce tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:54.541916 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-607f714a-40d9-464d-a361-822f4fded5ce tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:54.718968 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-607f714a-40d9-464d-a361-822f4fded5ce tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:54.730836 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-607f714a-40d9-464d-a361-822f4fded5ce tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:54.732501 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-607f714a-40d9-464d-a361-822f4fded5ce tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:54.734006 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-607f714a-40d9-464d-a361-822f4fded5ce tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1753 microversion: 2.20 time: 0.203570 May 04 19:08:54.745566 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 204/416] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:08:54 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1753 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:08:54.777272 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-ae243876-20e7-4e15-8298-8667e951a164 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:54.791922 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-ae243876-20e7-4e15-8298-8667e951a164 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 200 len: 1370 microversion: 2.1 time: 0.551454 May 04 19:08:54.792825 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 213/417] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:54 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 1370 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:55.497693 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-94e938b6-8a55-47c9-bc03-28c7b02e9f35 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:55.498325 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-94e938b6-8a55-47c9-bc03-28c7b02e9f35 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] [instance: 9d1266bd-77ec-4a0d-a557-71dafe7c5436] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:55.504602 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-94e938b6-8a55-47c9-bc03-28c7b02e9f35 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:55.505044 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-94e938b6-8a55-47c9-bc03-28c7b02e9f35 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:55.505813 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-94e938b6-8a55-47c9-bc03-28c7b02e9f35 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:55.506255 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-94e938b6-8a55-47c9-bc03-28c7b02e9f35 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:55.565649 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-94e938b6-8a55-47c9-bc03-28c7b02e9f35 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632af5ddc209419a93461afdb070fc87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedb3ef21b1e413395b1a4cdcfb3f4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:55.572833 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-94e938b6-8a55-47c9-bc03-28c7b02e9f35 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] 10.222.0.69 "GET /compute/v2.1/servers/9d1266bd-77ec-4a0d-a557-71dafe7c5436" status: 200 len: 1472 microversion: 2.1 time: 0.079004 May 04 19:08:55.573404 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 205/418] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:55 2022] GET /compute/v2.1/servers/9d1266bd-77ec-4a0d-a557-71dafe7c5436 => generated 1472 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:55.751984 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-4f291800-26d3-4425-a22a-db542ffec6ff tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:55.752500 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-4f291800-26d3-4425-a22a-db542ffec6ff tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:55.758772 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4f291800-26d3-4425-a22a-db542ffec6ff tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:55.759224 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4f291800-26d3-4425-a22a-db542ffec6ff tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:55.760303 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4f291800-26d3-4425-a22a-db542ffec6ff tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:55.760396 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4f291800-26d3-4425-a22a-db542ffec6ff tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:55.769667 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-1591a57c-1a5a-4ac0-8f7d-c590060b640d req-ecb44d64-19f6-42df-8226-57a7b87ae544 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d1266bd-77ec-4a0d-a557-71dafe7c5436", "name": "network-vif-deleted", "tag": "cf5bc90a-dbe3-486e-b992-7836d9d6b2bb"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:08:55.778406 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-1591a57c-1a5a-4ac0-8f7d-c590060b640d req-ecb44d64-19f6-42df-8226-57a7b87ae544 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:55.778953 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-1591a57c-1a5a-4ac0-8f7d-c590060b640d req-ecb44d64-19f6-42df-8226-57a7b87ae544 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:55.790068 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-1591a57c-1a5a-4ac0-8f7d-c590060b640d req-ecb44d64-19f6-42df-8226-57a7b87ae544 service nova] Creating event network-vif-deleted:cf5bc90a-dbe3-486e-b992-7836d9d6b2bb for instance 9d1266bd-77ec-4a0d-a557-71dafe7c5436 on hv-cinder-83090 May 04 19:08:55.794967 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-1591a57c-1a5a-4ac0-8f7d-c590060b640d req-ecb44d64-19f6-42df-8226-57a7b87ae544 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029248 May 04 19:08:55.795649 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 206/419] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 04 19:08:55.808224 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-fdc0cde6-ca30-4d11-bc8d-56522bc5aa7f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:55.808919 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-fdc0cde6-ca30-4d11-bc8d-56522bc5aa7f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:55.815027 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-fdc0cde6-ca30-4d11-bc8d-56522bc5aa7f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:55.815475 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-fdc0cde6-ca30-4d11-bc8d-56522bc5aa7f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:55.816233 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-fdc0cde6-ca30-4d11-bc8d-56522bc5aa7f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:55.816668 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-fdc0cde6-ca30-4d11-bc8d-56522bc5aa7f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:55.889584 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-4f291800-26d3-4425-a22a-db542ffec6ff tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:55.899599 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-4f291800-26d3-4425-a22a-db542ffec6ff tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:55.900966 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-4f291800-26d3-4425-a22a-db542ffec6ff tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:55.902320 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-4f291800-26d3-4425-a22a-db542ffec6ff tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1753 microversion: 2.20 time: 0.154254 May 04 19:08:55.905518 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 214/420] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:08:55 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:08:55.946595 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-fdc0cde6-ca30-4d11-bc8d-56522bc5aa7f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:55.947987 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-1dcfbdfa-9caa-4747-b7e3-e4025c2d7025 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "95402f99-7bfa-4e95-9f62-d89ba73424fc"}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:08:55.949099 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-1dcfbdfa-9caa-4747-b7e3-e4025c2d7025 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: fae4a97e-a910-4f71-abf2-8f62425c6a52] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:55.953988 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-fdc0cde6-ca30-4d11-bc8d-56522bc5aa7f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 200 len: 1370 microversion: 2.1 time: 0.149760 May 04 19:08:55.954559 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 207/421] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:55 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:08:55.955321 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1dcfbdfa-9caa-4747-b7e3-e4025c2d7025 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:55.955774 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1dcfbdfa-9caa-4747-b7e3-e4025c2d7025 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:55.956567 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1dcfbdfa-9caa-4747-b7e3-e4025c2d7025 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:55.956997 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1dcfbdfa-9caa-4747-b7e3-e4025c2d7025 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:56.403808 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-1dcfbdfa-9caa-4747-b7e3-e4025c2d7025 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "POST /compute/v2.1/servers/fae4a97e-a910-4f71-abf2-8f62425c6a52/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.460028 May 04 19:08:56.404407 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 215/422] 10.222.0.69 () {60 vars in 1322 bytes} [Wed May 4 19:08:55 2022] POST /compute/v2.1/servers/fae4a97e-a910-4f71-abf2-8f62425c6a52/os-volume_attachments => generated 194 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 04 19:08:56.591829 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-8425bd9b-8bf8-4518-a625-aa898cbdb8a5 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:56.592527 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-8425bd9b-8bf8-4518-a625-aa898cbdb8a5 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] [instance: 9d1266bd-77ec-4a0d-a557-71dafe7c5436] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:56.599149 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8425bd9b-8bf8-4518-a625-aa898cbdb8a5 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:56.599600 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8425bd9b-8bf8-4518-a625-aa898cbdb8a5 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:56.600441 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8425bd9b-8bf8-4518-a625-aa898cbdb8a5 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:56.600881 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8425bd9b-8bf8-4518-a625-aa898cbdb8a5 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:56.636815 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8425bd9b-8bf8-4518-a625-aa898cbdb8a5 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:56.637263 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8425bd9b-8bf8-4518-a625-aa898cbdb8a5 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:56.637736 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.objects.instance [None req-8425bd9b-8bf8-4518-a625-aa898cbdb8a5 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lazy-loading 'fault' on Instance uuid 9d1266bd-77ec-4a0d-a557-71dafe7c5436 {{(pid=117125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 04 19:08:56.678995 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-8425bd9b-8bf8-4518-a625-aa898cbdb8a5 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632af5ddc209419a93461afdb070fc87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedb3ef21b1e413395b1a4cdcfb3f4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:56.686329 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-8425bd9b-8bf8-4518-a625-aa898cbdb8a5 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] 10.222.0.69 "GET /compute/v2.1/servers/9d1266bd-77ec-4a0d-a557-71dafe7c5436" status: 200 len: 1309 microversion: 2.1 time: 0.100183 May 04 19:08:56.687091 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 208/423] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:56 2022] GET /compute/v2.1/servers/9d1266bd-77ec-4a0d-a557-71dafe7c5436 => generated 1309 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:56.921204 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-07d3692b-e25e-4ebb-904c-5e74acb250f7 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:56.921867 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-07d3692b-e25e-4ebb-904c-5e74acb250f7 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:56.927976 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-07d3692b-e25e-4ebb-904c-5e74acb250f7 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:56.928977 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-07d3692b-e25e-4ebb-904c-5e74acb250f7 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:56.929783 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-07d3692b-e25e-4ebb-904c-5e74acb250f7 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:56.930221 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-07d3692b-e25e-4ebb-904c-5e74acb250f7 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:56.971151 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-0ca95bf9-3dc3-44ba-b78b-fdc626ae5b65 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:56.972007 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-0ca95bf9-3dc3-44ba-b78b-fdc626ae5b65 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:56.978635 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0ca95bf9-3dc3-44ba-b78b-fdc626ae5b65 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:56.979105 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0ca95bf9-3dc3-44ba-b78b-fdc626ae5b65 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:56.979874 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0ca95bf9-3dc3-44ba-b78b-fdc626ae5b65 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:56.980304 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0ca95bf9-3dc3-44ba-b78b-fdc626ae5b65 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:57.121978 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-0ca95bf9-3dc3-44ba-b78b-fdc626ae5b65 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:57.129530 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-0ca95bf9-3dc3-44ba-b78b-fdc626ae5b65 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 200 len: 1370 microversion: 2.1 time: 0.162112 May 04 19:08:57.130157 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 209/424] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:56 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 1370 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:08:57.142438 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-07d3692b-e25e-4ebb-904c-5e74acb250f7 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:57.151310 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-07d3692b-e25e-4ebb-904c-5e74acb250f7 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:57.152799 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-07d3692b-e25e-4ebb-904c-5e74acb250f7 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:57.153995 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-07d3692b-e25e-4ebb-904c-5e74acb250f7 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1809 microversion: 2.20 time: 0.237594 May 04 19:08:57.154542 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 216/425] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:08:56 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1809 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:08:57.704110 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-bf06948c-4ab6-4cde-90ec-83a5e8881d80 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:57.704641 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-bf06948c-4ab6-4cde-90ec-83a5e8881d80 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] [instance: 9d1266bd-77ec-4a0d-a557-71dafe7c5436] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:57.712203 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-bf06948c-4ab6-4cde-90ec-83a5e8881d80 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:57.712651 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-bf06948c-4ab6-4cde-90ec-83a5e8881d80 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:57.713420 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-bf06948c-4ab6-4cde-90ec-83a5e8881d80 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:57.713883 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-bf06948c-4ab6-4cde-90ec-83a5e8881d80 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:57.727183 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.wsgi [None req-bf06948c-4ab6-4cde-90ec-83a5e8881d80 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] HTTP exception thrown: Instance 9d1266bd-77ec-4a0d-a557-71dafe7c5436 could not be found. May 04 19:08:57.727780 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-bf06948c-4ab6-4cde-90ec-83a5e8881d80 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Returning 404 to user: Instance 9d1266bd-77ec-4a0d-a557-71dafe7c5436 could not be found. {{(pid=117125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 04 19:08:57.728652 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-bf06948c-4ab6-4cde-90ec-83a5e8881d80 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] 10.222.0.69 "GET /compute/v2.1/servers/9d1266bd-77ec-4a0d-a557-71dafe7c5436" status: 404 len: 111 microversion: 2.1 time: 0.028452 May 04 19:08:57.730536 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 210/426] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:57 2022] GET /compute/v2.1/servers/9d1266bd-77ec-4a0d-a557-71dafe7c5436 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 04 19:08:58.146566 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-7c9e4c00-c070-4bc1-b7f3-141ce9a217d4 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:58.147237 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-7c9e4c00-c070-4bc1-b7f3-141ce9a217d4 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:58.153434 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7c9e4c00-c070-4bc1-b7f3-141ce9a217d4 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:58.153912 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7c9e4c00-c070-4bc1-b7f3-141ce9a217d4 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:58.154671 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7c9e4c00-c070-4bc1-b7f3-141ce9a217d4 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:58.155104 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7c9e4c00-c070-4bc1-b7f3-141ce9a217d4 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:58.172375 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-b896cb73-ac50-432c-8dbf-af16e86ad64c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:58.173012 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-b896cb73-ac50-432c-8dbf-af16e86ad64c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:58.179533 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b896cb73-ac50-432c-8dbf-af16e86ad64c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:58.179989 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b896cb73-ac50-432c-8dbf-af16e86ad64c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:58.180934 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b896cb73-ac50-432c-8dbf-af16e86ad64c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:58.181332 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b896cb73-ac50-432c-8dbf-af16e86ad64c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:58.310554 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-7c9e4c00-c070-4bc1-b7f3-141ce9a217d4 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:58.319387 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-7c9e4c00-c070-4bc1-b7f3-141ce9a217d4 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 200 len: 1370 microversion: 2.1 time: 0.176544 May 04 19:08:58.320395 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 217/427] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:58 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 1370 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:58.336658 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-b896cb73-ac50-432c-8dbf-af16e86ad64c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:58.346204 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-b896cb73-ac50-432c-8dbf-af16e86ad64c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:58.348016 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-b896cb73-ac50-432c-8dbf-af16e86ad64c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:58.349293 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-b896cb73-ac50-432c-8dbf-af16e86ad64c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1809 microversion: 2.20 time: 0.180879 May 04 19:08:58.350494 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 211/428] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:08:58 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1809 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 04 19:08:59.336823 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-c9937f85-3d6d-47f1-9e18-3eb59999fa15 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:59.337435 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-c9937f85-3d6d-47f1-9e18-3eb59999fa15 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:59.343785 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c9937f85-3d6d-47f1-9e18-3eb59999fa15 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:59.344233 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c9937f85-3d6d-47f1-9e18-3eb59999fa15 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:59.344997 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c9937f85-3d6d-47f1-9e18-3eb59999fa15 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:59.345433 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c9937f85-3d6d-47f1-9e18-3eb59999fa15 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:59.367677 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-065a08ce-ff84-4e07-9ab5-415b756b6584 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:08:59.368308 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-065a08ce-ff84-4e07-9ab5-415b756b6584 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:08:59.374724 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-065a08ce-ff84-4e07-9ab5-415b756b6584 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:59.375208 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-065a08ce-ff84-4e07-9ab5-415b756b6584 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:59.375979 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-065a08ce-ff84-4e07-9ab5-415b756b6584 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:08:59.376421 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-065a08ce-ff84-4e07-9ab5-415b756b6584 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:08:59.471068 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-c9937f85-3d6d-47f1-9e18-3eb59999fa15 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:59.479099 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-c9937f85-3d6d-47f1-9e18-3eb59999fa15 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 200 len: 1370 microversion: 2.1 time: 0.146643 May 04 19:08:59.479673 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 218/429] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:08:59 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 1370 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:08:59.503461 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-065a08ce-ff84-4e07-9ab5-415b756b6584 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:59.511617 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-065a08ce-ff84-4e07-9ab5-415b756b6584 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:59.513184 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-065a08ce-ff84-4e07-9ab5-415b756b6584 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:08:59.514423 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-065a08ce-ff84-4e07-9ab5-415b756b6584 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1809 microversion: 2.20 time: 0.150655 May 04 19:08:59.514974 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 212/430] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:08:59 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1809 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 04 19:09:00.496614 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-d0684a78-d610-40b1-b7b2-5577bf5a5827 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:00.497200 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-d0684a78-d610-40b1-b7b2-5577bf5a5827 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:00.504054 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d0684a78-d610-40b1-b7b2-5577bf5a5827 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:00.504509 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d0684a78-d610-40b1-b7b2-5577bf5a5827 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:00.505299 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d0684a78-d610-40b1-b7b2-5577bf5a5827 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:00.505773 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d0684a78-d610-40b1-b7b2-5577bf5a5827 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:00.532831 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-11f2936b-6684-49ab-8a42-871a397b22be tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:00.533433 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-11f2936b-6684-49ab-8a42-871a397b22be tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:00.541127 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-11f2936b-6684-49ab-8a42-871a397b22be tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:00.541710 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-11f2936b-6684-49ab-8a42-871a397b22be tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:00.542742 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-11f2936b-6684-49ab-8a42-871a397b22be tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:00.543250 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-11f2936b-6684-49ab-8a42-871a397b22be tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:00.656251 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-d0684a78-d610-40b1-b7b2-5577bf5a5827 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:00.666483 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-d0684a78-d610-40b1-b7b2-5577bf5a5827 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 200 len: 1370 microversion: 2.1 time: 0.174429 May 04 19:09:00.676503 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 219/431] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:09:00 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 1370 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:09:00.696255 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-11f2936b-6684-49ab-8a42-871a397b22be tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:00.704733 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-11f2936b-6684-49ab-8a42-871a397b22be tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:00.706342 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-11f2936b-6684-49ab-8a42-871a397b22be tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:00.707535 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-11f2936b-6684-49ab-8a42-871a397b22be tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1809 microversion: 2.20 time: 0.178485 May 04 19:09:00.708147 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 213/432] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:09:00 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:09:01.684231 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-f0126e88-a3e3-4dbb-96f4-d3d9ddfda8db tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:01.684740 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-f0126e88-a3e3-4dbb-96f4-d3d9ddfda8db tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:01.691465 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f0126e88-a3e3-4dbb-96f4-d3d9ddfda8db tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:01.691930 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f0126e88-a3e3-4dbb-96f4-d3d9ddfda8db tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:01.692672 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f0126e88-a3e3-4dbb-96f4-d3d9ddfda8db tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:01.693103 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f0126e88-a3e3-4dbb-96f4-d3d9ddfda8db tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:01.727270 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-52d42ba4-6ef7-4f6f-93e9-b8fb3441f128 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:01.728392 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-52d42ba4-6ef7-4f6f-93e9-b8fb3441f128 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:01.735800 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-52d42ba4-6ef7-4f6f-93e9-b8fb3441f128 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:01.736483 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-52d42ba4-6ef7-4f6f-93e9-b8fb3441f128 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:01.737299 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-52d42ba4-6ef7-4f6f-93e9-b8fb3441f128 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:01.737761 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-52d42ba4-6ef7-4f6f-93e9-b8fb3441f128 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:01.849114 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-f0126e88-a3e3-4dbb-96f4-d3d9ddfda8db tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:01.858239 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-f0126e88-a3e3-4dbb-96f4-d3d9ddfda8db tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 200 len: 1370 microversion: 2.1 time: 0.177880 May 04 19:09:01.858826 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 220/433] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:09:01 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 1370 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:09:01.871668 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-52d42ba4-6ef7-4f6f-93e9-b8fb3441f128 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:01.880134 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-52d42ba4-6ef7-4f6f-93e9-b8fb3441f128 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:01.881730 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-52d42ba4-6ef7-4f6f-93e9-b8fb3441f128 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:01.882914 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-52d42ba4-6ef7-4f6f-93e9-b8fb3441f128 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1809 microversion: 2.20 time: 0.160989 May 04 19:09:01.883689 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 214/434] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:09:01 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:09:02.877593 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-54acc1cb-8727-47c1-ae49-19ae9f94b428 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:02.879369 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-54acc1cb-8727-47c1-ae49-19ae9f94b428 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:02.888207 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-54acc1cb-8727-47c1-ae49-19ae9f94b428 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:02.889307 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-54acc1cb-8727-47c1-ae49-19ae9f94b428 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:02.890756 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-54acc1cb-8727-47c1-ae49-19ae9f94b428 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:02.891414 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-54acc1cb-8727-47c1-ae49-19ae9f94b428 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:02.902807 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-63a0430a-cbe4-48da-ba71-8961d9585b98 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:02.903626 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-63a0430a-cbe4-48da-ba71-8961d9585b98 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:02.913603 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-63a0430a-cbe4-48da-ba71-8961d9585b98 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:02.914353 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-63a0430a-cbe4-48da-ba71-8961d9585b98 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:02.915213 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-63a0430a-cbe4-48da-ba71-8961d9585b98 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:02.915724 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-63a0430a-cbe4-48da-ba71-8961d9585b98 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:03.043429 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-54acc1cb-8727-47c1-ae49-19ae9f94b428 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:03.051457 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-54acc1cb-8727-47c1-ae49-19ae9f94b428 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 200 len: 1370 microversion: 2.1 time: 0.179720 May 04 19:09:03.052035 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 221/435] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:09:02 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 1370 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:09:03.099297 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-63a0430a-cbe4-48da-ba71-8961d9585b98 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:03.109429 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-63a0430a-cbe4-48da-ba71-8961d9585b98 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:03.112206 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-63a0430a-cbe4-48da-ba71-8961d9585b98 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:03.113678 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-63a0430a-cbe4-48da-ba71-8961d9585b98 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1809 microversion: 2.20 time: 0.216172 May 04 19:09:03.114427 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 215/436] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:09:02 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1809 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 04 19:09:03.341891 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-43c83a13-b01c-4211-b569-d3c2f2fccc2c req-348e14f4-bdc1-4269-b7bd-ffc419e58d8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17de0a81-ab42-475e-b6f3-dd853adc826c", "name": "network-vif-plugged", "status": "completed", "tag": "e11de5fb-b02b-4516-8fa9-a612b9b432a0"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:09:03.352653 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-43c83a13-b01c-4211-b569-d3c2f2fccc2c req-348e14f4-bdc1-4269-b7bd-ffc419e58d8e service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:03.353424 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-43c83a13-b01c-4211-b569-d3c2f2fccc2c req-348e14f4-bdc1-4269-b7bd-ffc419e58d8e service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:03.380457 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-43c83a13-b01c-4211-b569-d3c2f2fccc2c req-348e14f4-bdc1-4269-b7bd-ffc419e58d8e service nova] Creating event network-vif-plugged:e11de5fb-b02b-4516-8fa9-a612b9b432a0 for instance 17de0a81-ab42-475e-b6f3-dd853adc826c on hv-cinder-83090 May 04 19:09:03.386473 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-43c83a13-b01c-4211-b569-d3c2f2fccc2c req-348e14f4-bdc1-4269-b7bd-ffc419e58d8e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049809 May 04 19:09:03.387692 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 222/437] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:09:04.070716 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-d834065b-9010-4b40-b593-e21ca79df883 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:04.071438 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-d834065b-9010-4b40-b593-e21ca79df883 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:04.078717 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d834065b-9010-4b40-b593-e21ca79df883 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:04.079165 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d834065b-9010-4b40-b593-e21ca79df883 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:04.079929 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d834065b-9010-4b40-b593-e21ca79df883 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:04.080365 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d834065b-9010-4b40-b593-e21ca79df883 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:04.133567 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-941215d5-1838-4f85-8e20-6799c41906ba tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:04.134284 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-941215d5-1838-4f85-8e20-6799c41906ba tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:04.141056 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-941215d5-1838-4f85-8e20-6799c41906ba tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:04.141529 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-941215d5-1838-4f85-8e20-6799c41906ba tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:04.142766 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-941215d5-1838-4f85-8e20-6799c41906ba tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:04.143205 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-941215d5-1838-4f85-8e20-6799c41906ba tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:04.222952 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-d834065b-9010-4b40-b593-e21ca79df883 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:04.232070 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-d834065b-9010-4b40-b593-e21ca79df883 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 200 len: 1370 microversion: 2.1 time: 0.165608 May 04 19:09:04.232516 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 216/438] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:09:04 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 1370 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:09:04.289590 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-941215d5-1838-4f85-8e20-6799c41906ba tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:04.298911 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-941215d5-1838-4f85-8e20-6799c41906ba tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:04.300392 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-941215d5-1838-4f85-8e20-6799c41906ba tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:04.301585 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-941215d5-1838-4f85-8e20-6799c41906ba tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1809 microversion: 2.20 time: 0.172885 May 04 19:09:04.302327 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 223/439] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:09:04 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 04 19:09:05.248920 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-29eb0b42-bab2-4961-8421-3364f207ee4d tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:05.249533 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-29eb0b42-bab2-4961-8421-3364f207ee4d tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:05.256139 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-29eb0b42-bab2-4961-8421-3364f207ee4d tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:05.256666 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-29eb0b42-bab2-4961-8421-3364f207ee4d tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:05.257943 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-29eb0b42-bab2-4961-8421-3364f207ee4d tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:05.258382 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-29eb0b42-bab2-4961-8421-3364f207ee4d tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:05.321480 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-5d224bd3-50bd-4520-bd87-5ca4f605679d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:05.322776 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-5d224bd3-50bd-4520-bd87-5ca4f605679d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:05.329152 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5d224bd3-50bd-4520-bd87-5ca4f605679d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:05.329628 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5d224bd3-50bd-4520-bd87-5ca4f605679d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:05.330665 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5d224bd3-50bd-4520-bd87-5ca4f605679d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:05.331047 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5d224bd3-50bd-4520-bd87-5ca4f605679d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:05.427295 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-29eb0b42-bab2-4961-8421-3364f207ee4d tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:05.451680 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-29eb0b42-bab2-4961-8421-3364f207ee4d tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 200 len: 1370 microversion: 2.1 time: 0.206785 May 04 19:09:05.452272 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 217/440] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:09:05 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 1370 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:09:05.483537 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-5d224bd3-50bd-4520-bd87-5ca4f605679d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:05.492617 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-5d224bd3-50bd-4520-bd87-5ca4f605679d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:05.494153 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-5d224bd3-50bd-4520-bd87-5ca4f605679d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:05.495336 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-5d224bd3-50bd-4520-bd87-5ca4f605679d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1809 microversion: 2.20 time: 0.178982 May 04 19:09:05.495934 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 224/441] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:09:05 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 04 19:09:06.468781 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-d4fe278b-750d-4c77-a665-fe14f29b41ee tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:06.469451 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-d4fe278b-750d-4c77-a665-fe14f29b41ee tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:06.476993 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d4fe278b-750d-4c77-a665-fe14f29b41ee tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:06.477445 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d4fe278b-750d-4c77-a665-fe14f29b41ee tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:06.478269 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d4fe278b-750d-4c77-a665-fe14f29b41ee tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:06.478704 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d4fe278b-750d-4c77-a665-fe14f29b41ee tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:06.513434 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-9bc326e7-0f93-4bb8-8c62-155d1d817eff tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:06.514074 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-9bc326e7-0f93-4bb8-8c62-155d1d817eff tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:06.520371 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9bc326e7-0f93-4bb8-8c62-155d1d817eff tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:06.520827 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9bc326e7-0f93-4bb8-8c62-155d1d817eff tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:06.524478 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9bc326e7-0f93-4bb8-8c62-155d1d817eff tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:06.524478 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9bc326e7-0f93-4bb8-8c62-155d1d817eff tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:06.621069 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-d4fe278b-750d-4c77-a665-fe14f29b41ee tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:06.629318 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-d4fe278b-750d-4c77-a665-fe14f29b41ee tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 200 len: 1370 microversion: 2.1 time: 0.164625 May 04 19:09:06.629963 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 218/442] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:09:06 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 1370 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:09:06.661787 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-9bc326e7-0f93-4bb8-8c62-155d1d817eff tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:06.671004 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-9bc326e7-0f93-4bb8-8c62-155d1d817eff tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:06.672709 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-9bc326e7-0f93-4bb8-8c62-155d1d817eff tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:06.673963 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-9bc326e7-0f93-4bb8-8c62-155d1d817eff tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1809 microversion: 2.20 time: 0.164631 May 04 19:09:06.674516 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 225/443] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:09:06 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 04 19:09:07.646911 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-cab66353-d50c-418a-943a-0e35445c4980 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:07.648325 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-cab66353-d50c-418a-943a-0e35445c4980 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:07.651028 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-e4983282-0b02-4a9c-b509-c5ce156b3d16 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1825854572", "imageRef": "2869595e-cda4-45af-aaeb-0779eb5f4114", "flavorRef": "452", "networks": [{"uuid": "5d74b4ea-3f57-4f2d-b82a-88a7a6abbbaa"}]}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:09:07.655168 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cab66353-d50c-418a-943a-0e35445c4980 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:07.655621 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cab66353-d50c-418a-943a-0e35445c4980 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:07.656401 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cab66353-d50c-418a-943a-0e35445c4980 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:07.656839 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cab66353-d50c-418a-943a-0e35445c4980 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:07.711895 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.network.neutron [None req-e4983282-0b02-4a9c-b509-c5ce156b3d16 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] validate_networks() for [('5d74b4ea-3f57-4f2d-b82a-88a7a6abbbaa', None, None, None, None, None)] {{(pid=117124) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 04 19:09:07.815579 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-cab66353-d50c-418a-943a-0e35445c4980 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:07.823675 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-cab66353-d50c-418a-943a-0e35445c4980 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 200 len: 1370 microversion: 2.1 time: 0.180914 May 04 19:09:07.824469 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 219/444] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:09:07 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 1370 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:09:07.828843 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-d4e365d4-77b8-45b4-b865-14fd3f81b7eb tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:07.829442 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-d4e365d4-77b8-45b4-b865-14fd3f81b7eb tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:07.835901 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d4e365d4-77b8-45b4-b865-14fd3f81b7eb tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:07.836495 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d4e365d4-77b8-45b4-b865-14fd3f81b7eb tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:07.837264 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d4e365d4-77b8-45b4-b865-14fd3f81b7eb tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:07.837793 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d4e365d4-77b8-45b4-b865-14fd3f81b7eb tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:07.998589 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-d4e365d4-77b8-45b4-b865-14fd3f81b7eb tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:08.008675 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-d4e365d4-77b8-45b4-b865-14fd3f81b7eb tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:08.010230 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-d4e365d4-77b8-45b4-b865-14fd3f81b7eb tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:08.011406 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-d4e365d4-77b8-45b4-b865-14fd3f81b7eb tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1809 microversion: 2.20 time: 0.186222 May 04 19:09:08.016345 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 220/445] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:09:07 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1809 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:09:08.127794 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-e4983282-0b02-4a9c-b509-c5ce156b3d16 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Flavor limits 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 04 19:09:08.128221 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-e4983282-0b02-4a9c-b509-c5ce156b3d16 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Image limits 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 04 19:09:08.128698 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-e4983282-0b02-4a9c-b509-c5ce156b3d16 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Flavor pref 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 04 19:09:08.129110 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-e4983282-0b02-4a9c-b509-c5ce156b3d16 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Image pref 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 04 19:09:08.129556 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-e4983282-0b02-4a9c-b509-c5ce156b3d16 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 04 19:09:08.139462 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e4983282-0b02-4a9c-b509-c5ce156b3d16 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:08.140026 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e4983282-0b02-4a9c-b509-c5ce156b3d16 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:08.140899 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e4983282-0b02-4a9c-b509-c5ce156b3d16 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:08.141405 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e4983282-0b02-4a9c-b509-c5ce156b3d16 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:08.158585 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-e4983282-0b02-4a9c-b509-c5ce156b3d16 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Getting quotas for project fedb3ef21b1e413395b1a4cdcfb3f4d6. Resources: {'cores', 'ram', 'instances'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 04 19:09:08.162778 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-e4983282-0b02-4a9c-b509-c5ce156b3d16 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Getting quotas for user 632af5ddc209419a93461afdb070fc87 and project fedb3ef21b1e413395b1a4cdcfb3f4d6. Resources: {'cores', 'ram', 'instances'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 04 19:09:08.175077 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-e4983282-0b02-4a9c-b509-c5ce156b3d16 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Going to run 1 instances... {{(pid=117124) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 04 19:09:08.177326 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-e4983282-0b02-4a9c-b509-c5ce156b3d16 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] [instance: 6b8b5bee-fd07-4dda-8996-a2d4099c151c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2869595e-cda4-45af-aaeb-0779eb5f4114',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 04 19:09:08.231579 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-e4983282-0b02-4a9c-b509-c5ce156b3d16 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.584858 May 04 19:09:08.233337 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 226/446] 10.222.0.69 () {60 vars in 1146 bytes} [Wed May 4 19:09:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 04 19:09:08.244940 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-ed743189-f7d1-4cf0-8c6b-c95aa963fa72 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:08.245979 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-ed743189-f7d1-4cf0-8c6b-c95aa963fa72 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] [instance: 6b8b5bee-fd07-4dda-8996-a2d4099c151c] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:08.320013 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-ed743189-f7d1-4cf0-8c6b-c95aa963fa72 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632af5ddc209419a93461afdb070fc87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedb3ef21b1e413395b1a4cdcfb3f4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:08.327103 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-ed743189-f7d1-4cf0-8c6b-c95aa963fa72 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] 10.222.0.69 "GET /compute/v2.1/servers/6b8b5bee-fd07-4dda-8996-a2d4099c151c" status: 200 len: 1219 microversion: 2.1 time: 0.086726 May 04 19:09:08.338299 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 221/447] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:09:08 2022] GET /compute/v2.1/servers/6b8b5bee-fd07-4dda-8996-a2d4099c151c => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:09:08.841251 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-84939544-aaf8-444f-932e-424934d0b490 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:08.841834 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-84939544-aaf8-444f-932e-424934d0b490 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:08.848807 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-84939544-aaf8-444f-932e-424934d0b490 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:08.849263 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-84939544-aaf8-444f-932e-424934d0b490 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:08.850523 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-84939544-aaf8-444f-932e-424934d0b490 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:08.850967 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-84939544-aaf8-444f-932e-424934d0b490 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:08.984995 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-84939544-aaf8-444f-932e-424934d0b490 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:08.992271 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-84939544-aaf8-444f-932e-424934d0b490 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 200 len: 1370 microversion: 2.1 time: 0.155452 May 04 19:09:08.992832 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 227/448] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:09:08 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:09:09.030161 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-4fc28220-ccb0-4c7f-8062-8dcd0076f8df tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:09.030846 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-4fc28220-ccb0-4c7f-8062-8dcd0076f8df tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:09.037307 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4fc28220-ccb0-4c7f-8062-8dcd0076f8df tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:09.037780 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4fc28220-ccb0-4c7f-8062-8dcd0076f8df tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:09.038576 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4fc28220-ccb0-4c7f-8062-8dcd0076f8df tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:09.039002 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4fc28220-ccb0-4c7f-8062-8dcd0076f8df tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:09.171137 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-4fc28220-ccb0-4c7f-8062-8dcd0076f8df tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:09.184180 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-4fc28220-ccb0-4c7f-8062-8dcd0076f8df tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:09.185703 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-4fc28220-ccb0-4c7f-8062-8dcd0076f8df tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:09.186864 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-4fc28220-ccb0-4c7f-8062-8dcd0076f8df tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1809 microversion: 2.20 time: 0.160725 May 04 19:09:09.187427 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 222/449] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:09:09 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:09:09.346721 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-eebbd650-5bae-40f6-8aeb-6a7eed470522 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:09.347337 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-eebbd650-5bae-40f6-8aeb-6a7eed470522 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] [instance: 6b8b5bee-fd07-4dda-8996-a2d4099c151c] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:09.353204 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-eebbd650-5bae-40f6-8aeb-6a7eed470522 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:09.353699 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-eebbd650-5bae-40f6-8aeb-6a7eed470522 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:09.354454 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-eebbd650-5bae-40f6-8aeb-6a7eed470522 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:09.354897 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-eebbd650-5bae-40f6-8aeb-6a7eed470522 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:09.414858 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-eebbd650-5bae-40f6-8aeb-6a7eed470522 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632af5ddc209419a93461afdb070fc87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedb3ef21b1e413395b1a4cdcfb3f4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:09.422363 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-eebbd650-5bae-40f6-8aeb-6a7eed470522 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] 10.222.0.69 "GET /compute/v2.1/servers/6b8b5bee-fd07-4dda-8996-a2d4099c151c" status: 200 len: 1223 microversion: 2.1 time: 0.079781 May 04 19:09:09.422944 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 228/450] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:09:09 2022] GET /compute/v2.1/servers/6b8b5bee-fd07-4dda-8996-a2d4099c151c => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:09:10.010386 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-b6012234-984f-4b6a-aaa4-b1e838906fa6 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:10.010992 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-b6012234-984f-4b6a-aaa4-b1e838906fa6 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:10.017439 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b6012234-984f-4b6a-aaa4-b1e838906fa6 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:10.017915 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b6012234-984f-4b6a-aaa4-b1e838906fa6 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:10.018663 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b6012234-984f-4b6a-aaa4-b1e838906fa6 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:10.019092 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b6012234-984f-4b6a-aaa4-b1e838906fa6 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:10.153029 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-b6012234-984f-4b6a-aaa4-b1e838906fa6 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:10.160170 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-b6012234-984f-4b6a-aaa4-b1e838906fa6 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 200 len: 1370 microversion: 2.1 time: 0.154373 May 04 19:09:10.160719 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 223/451] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:09:10 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:09:10.205943 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-8422d072-a203-4e54-a010-97fa4c357b07 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:10.206551 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-8422d072-a203-4e54-a010-97fa4c357b07 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:10.212847 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8422d072-a203-4e54-a010-97fa4c357b07 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:10.213296 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8422d072-a203-4e54-a010-97fa4c357b07 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:10.214087 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8422d072-a203-4e54-a010-97fa4c357b07 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:10.214522 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8422d072-a203-4e54-a010-97fa4c357b07 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:10.341075 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-8422d072-a203-4e54-a010-97fa4c357b07 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:10.349216 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-8422d072-a203-4e54-a010-97fa4c357b07 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:10.351241 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-8422d072-a203-4e54-a010-97fa4c357b07 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:10.352393 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-8422d072-a203-4e54-a010-97fa4c357b07 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1809 microversion: 2.20 time: 0.150296 May 04 19:09:10.352950 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 229/452] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:09:10 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1809 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 04 19:09:10.439481 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-41048f48-c2d7-4d73-929b-5971fc420ec0 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:10.440080 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-41048f48-c2d7-4d73-929b-5971fc420ec0 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] [instance: 6b8b5bee-fd07-4dda-8996-a2d4099c151c] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:10.445892 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-41048f48-c2d7-4d73-929b-5971fc420ec0 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:10.446335 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-41048f48-c2d7-4d73-929b-5971fc420ec0 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:10.447085 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-41048f48-c2d7-4d73-929b-5971fc420ec0 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:10.447514 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-41048f48-c2d7-4d73-929b-5971fc420ec0 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:10.512242 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-41048f48-c2d7-4d73-929b-5971fc420ec0 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632af5ddc209419a93461afdb070fc87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedb3ef21b1e413395b1a4cdcfb3f4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:10.519838 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-41048f48-c2d7-4d73-929b-5971fc420ec0 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] 10.222.0.69 "GET /compute/v2.1/servers/6b8b5bee-fd07-4dda-8996-a2d4099c151c" status: 200 len: 1223 microversion: 2.1 time: 0.084162 May 04 19:09:10.520393 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 224/453] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:09:10 2022] GET /compute/v2.1/servers/6b8b5bee-fd07-4dda-8996-a2d4099c151c => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:09:11.177374 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-f1c155af-bbed-4085-a49d-cb50bf01f62a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:11.178019 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-f1c155af-bbed-4085-a49d-cb50bf01f62a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:11.183847 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f1c155af-bbed-4085-a49d-cb50bf01f62a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:11.184297 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f1c155af-bbed-4085-a49d-cb50bf01f62a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:11.185055 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f1c155af-bbed-4085-a49d-cb50bf01f62a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:11.185515 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f1c155af-bbed-4085-a49d-cb50bf01f62a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:11.313399 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-f1c155af-bbed-4085-a49d-cb50bf01f62a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:11.321232 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-f1c155af-bbed-4085-a49d-cb50bf01f62a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 200 len: 1370 microversion: 2.1 time: 0.147732 May 04 19:09:11.321822 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 230/454] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:09:11 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 1370 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:09:11.370718 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-b4d58e5b-b238-42a8-8cb4-b3a91677cfec tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:11.371329 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-b4d58e5b-b238-42a8-8cb4-b3a91677cfec tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:11.377584 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b4d58e5b-b238-42a8-8cb4-b3a91677cfec tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:11.378031 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b4d58e5b-b238-42a8-8cb4-b3a91677cfec tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:11.378784 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b4d58e5b-b238-42a8-8cb4-b3a91677cfec tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:11.379218 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b4d58e5b-b238-42a8-8cb4-b3a91677cfec tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:11.524542 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-b4d58e5b-b238-42a8-8cb4-b3a91677cfec tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:11.536459 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-901938a1-a650-4a59-bc9c-c8c45884f55a tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:11.537132 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-901938a1-a650-4a59-bc9c-c8c45884f55a tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] [instance: 6b8b5bee-fd07-4dda-8996-a2d4099c151c] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:11.545514 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-901938a1-a650-4a59-bc9c-c8c45884f55a tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:11.545980 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-901938a1-a650-4a59-bc9c-c8c45884f55a tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:11.546527 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-b4d58e5b-b238-42a8-8cb4-b3a91677cfec tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:11.546804 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-901938a1-a650-4a59-bc9c-c8c45884f55a tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:11.547187 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-901938a1-a650-4a59-bc9c-c8c45884f55a tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:11.548630 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-b4d58e5b-b238-42a8-8cb4-b3a91677cfec tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:11.550088 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-b4d58e5b-b238-42a8-8cb4-b3a91677cfec tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1809 microversion: 2.20 time: 0.183655 May 04 19:09:11.551175 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 225/455] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:09:11 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1809 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:09:11.630800 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-901938a1-a650-4a59-bc9c-c8c45884f55a tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632af5ddc209419a93461afdb070fc87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedb3ef21b1e413395b1a4cdcfb3f4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:11.639655 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-901938a1-a650-4a59-bc9c-c8c45884f55a tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] 10.222.0.69 "GET /compute/v2.1/servers/6b8b5bee-fd07-4dda-8996-a2d4099c151c" status: 200 len: 1271 microversion: 2.1 time: 0.107029 May 04 19:09:11.640591 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 231/456] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:09:11 2022] GET /compute/v2.1/servers/6b8b5bee-fd07-4dda-8996-a2d4099c151c => generated 1271 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:09:12.338089 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-71d48bcf-30de-4b3f-a542-a6ec5e28476b tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:12.338799 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-71d48bcf-30de-4b3f-a542-a6ec5e28476b tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:12.344688 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-71d48bcf-30de-4b3f-a542-a6ec5e28476b tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:12.345137 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-71d48bcf-30de-4b3f-a542-a6ec5e28476b tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:12.345925 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-71d48bcf-30de-4b3f-a542-a6ec5e28476b tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:12.346372 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-71d48bcf-30de-4b3f-a542-a6ec5e28476b tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:12.359496 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-7b0c52c1-7f6a-4582-8abf-2654bed4f505 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Action: 'create', calling method: .version_select at 0x7fc3f75a20d0>, body: {"keypair": {"name": "tempest-keypair-1531871535"}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:09:12.373393 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-7b0c52c1-7f6a-4582-8abf-2654bed4f505 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Getting quotas for project ef1ba9318cf84308a3ff6ce6da85755d. Resources: {'key_pairs'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 04 19:09:12.377122 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-7b0c52c1-7f6a-4582-8abf-2654bed4f505 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Getting quotas for user 98211cfafca84542a64f8b3f0b34303b and project ef1ba9318cf84308a3ff6ce6da85755d. Resources: {'key_pairs'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 04 19:09:12.478729 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-71d48bcf-30de-4b3f-a542-a6ec5e28476b tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:12.485938 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-71d48bcf-30de-4b3f-a542-a6ec5e28476b tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 200 len: 1370 microversion: 2.1 time: 0.151776 May 04 19:09:12.486503 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 226/457] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:09:12 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:09:12.568546 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-2a651bf0-dad2-4d4d-8fce-a71590a884f5 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:12.569422 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-2a651bf0-dad2-4d4d-8fce-a71590a884f5 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:12.575296 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2a651bf0-dad2-4d4d-8fce-a71590a884f5 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:12.575817 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2a651bf0-dad2-4d4d-8fce-a71590a884f5 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:12.576676 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2a651bf0-dad2-4d4d-8fce-a71590a884f5 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:12.577214 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2a651bf0-dad2-4d4d-8fce-a71590a884f5 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:12.711088 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-2a651bf0-dad2-4d4d-8fce-a71590a884f5 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:12.719634 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-2a651bf0-dad2-4d4d-8fce-a71590a884f5 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:12.721143 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-2a651bf0-dad2-4d4d-8fce-a71590a884f5 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:12.722464 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-2a651bf0-dad2-4d4d-8fce-a71590a884f5 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1809 microversion: 2.20 time: 0.158063 May 04 19:09:12.723031 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 227/458] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:09:12 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:09:12.729921 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-f7bf1c06-baaa-4373-99d3-a8d29af195e0 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:12.729921 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-f7bf1c06-baaa-4373-99d3-a8d29af195e0 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] [instance: 6b8b5bee-fd07-4dda-8996-a2d4099c151c] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:12.734231 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f7bf1c06-baaa-4373-99d3-a8d29af195e0 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:12.734681 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f7bf1c06-baaa-4373-99d3-a8d29af195e0 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:12.735472 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f7bf1c06-baaa-4373-99d3-a8d29af195e0 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:12.735938 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f7bf1c06-baaa-4373-99d3-a8d29af195e0 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:12.811518 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-f7bf1c06-baaa-4373-99d3-a8d29af195e0 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632af5ddc209419a93461afdb070fc87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedb3ef21b1e413395b1a4cdcfb3f4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:12.819669 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-f7bf1c06-baaa-4373-99d3-a8d29af195e0 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] 10.222.0.69 "GET /compute/v2.1/servers/6b8b5bee-fd07-4dda-8996-a2d4099c151c" status: 200 len: 1279 microversion: 2.1 time: 0.095622 May 04 19:09:12.820322 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 228/459] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:09:12 2022] GET /compute/v2.1/servers/6b8b5bee-fd07-4dda-8996-a2d4099c151c => generated 1279 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:09:13.267254 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-7b0c52c1-7f6a-4582-8abf-2654bed4f505 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Getting quotas for project ef1ba9318cf84308a3ff6ce6da85755d. Resources: {'key_pairs'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 04 19:09:13.270894 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-7b0c52c1-7f6a-4582-8abf-2654bed4f505 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Getting quotas for user 98211cfafca84542a64f8b3f0b34303b and project ef1ba9318cf84308a3ff6ce6da85755d. Resources: {'key_pairs'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 04 19:09:13.283985 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-7b0c52c1-7f6a-4582-8abf-2654bed4f505 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.928222 May 04 19:09:13.284586 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 232/460] 10.222.0.69 () {60 vars in 1157 bytes} [Wed May 4 19:09:12 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:09:13.503825 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-1093c434-d26f-46e5-8243-0b8acedb3319 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:13.504237 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-1093c434-d26f-46e5-8243-0b8acedb3319 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:13.511664 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1093c434-d26f-46e5-8243-0b8acedb3319 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:13.511664 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1093c434-d26f-46e5-8243-0b8acedb3319 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:13.512900 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1093c434-d26f-46e5-8243-0b8acedb3319 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:13.512900 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1093c434-d26f-46e5-8243-0b8acedb3319 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:13.695986 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-1093c434-d26f-46e5-8243-0b8acedb3319 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:13.703707 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-1093c434-d26f-46e5-8243-0b8acedb3319 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 200 len: 1564 microversion: 2.1 time: 0.204145 May 04 19:09:13.704293 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 229/461] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:09:13 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 1564 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:09:13.721108 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-5c195ba0-4ff8-41a3-87ba-46da87cdb11c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:13.721720 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-5c195ba0-4ff8-41a3-87ba-46da87cdb11c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:13.730203 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5c195ba0-4ff8-41a3-87ba-46da87cdb11c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:13.730203 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5c195ba0-4ff8-41a3-87ba-46da87cdb11c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:13.730203 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5c195ba0-4ff8-41a3-87ba-46da87cdb11c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:13.730203 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5c195ba0-4ff8-41a3-87ba-46da87cdb11c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:13.741737 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-6d319481-3902-4a71-8eab-99c6899562eb tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:13.742444 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-6d319481-3902-4a71-8eab-99c6899562eb tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:13.748579 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6d319481-3902-4a71-8eab-99c6899562eb tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:13.749155 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6d319481-3902-4a71-8eab-99c6899562eb tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:13.750037 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6d319481-3902-4a71-8eab-99c6899562eb tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:13.750480 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6d319481-3902-4a71-8eab-99c6899562eb tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:13.812638 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-5c195ba0-4ff8-41a3-87ba-46da87cdb11c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095868 May 04 19:09:13.820551 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 233/462] 10.222.0.69 () {58 vars in 1274 bytes} [Wed May 4 19:09:13 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:09:13.836960 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-d54fd4d4-d677-41df-87b8-aeb2e4b3d9eb tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:13.837867 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-d54fd4d4-d677-41df-87b8-aeb2e4b3d9eb tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] [instance: 6b8b5bee-fd07-4dda-8996-a2d4099c151c] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:13.844241 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d54fd4d4-d677-41df-87b8-aeb2e4b3d9eb tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:13.845249 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d54fd4d4-d677-41df-87b8-aeb2e4b3d9eb tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:13.846060 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d54fd4d4-d677-41df-87b8-aeb2e4b3d9eb tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:13.847256 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d54fd4d4-d677-41df-87b8-aeb2e4b3d9eb tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:14.080404 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-d54fd4d4-d677-41df-87b8-aeb2e4b3d9eb tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632af5ddc209419a93461afdb070fc87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedb3ef21b1e413395b1a4cdcfb3f4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:14.088747 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-d54fd4d4-d677-41df-87b8-aeb2e4b3d9eb tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] 10.222.0.69 "GET /compute/v2.1/servers/6b8b5bee-fd07-4dda-8996-a2d4099c151c" status: 200 len: 1319 microversion: 2.1 time: 0.256345 May 04 19:09:14.088946 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-6d319481-3902-4a71-8eab-99c6899562eb tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:14.090061 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 234/463] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:09:13 2022] GET /compute/v2.1/servers/6b8b5bee-fd07-4dda-8996-a2d4099c151c => generated 1319 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:09:14.101357 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-6d319481-3902-4a71-8eab-99c6899562eb tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:14.103027 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-6d319481-3902-4a71-8eab-99c6899562eb tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:14.104314 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-6d319481-3902-4a71-8eab-99c6899562eb tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1809 microversion: 2.20 time: 0.367285 May 04 19:09:14.104871 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 230/464] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:09:13 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1809 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 04 19:09:14.533448 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-f05c3861-6113-4ffc-b23e-eae55d6e65a1 req-91ef58aa-1068-4dc8-8a69-f416848b1612 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b8b5bee-fd07-4dda-8996-a2d4099c151c", "tag": "d2d16c3a-ab38-4e7c-98b2-a43d2b35343b"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:09:14.542842 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-f05c3861-6113-4ffc-b23e-eae55d6e65a1 req-91ef58aa-1068-4dc8-8a69-f416848b1612 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:14.543638 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-f05c3861-6113-4ffc-b23e-eae55d6e65a1 req-91ef58aa-1068-4dc8-8a69-f416848b1612 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:14.556177 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-f05c3861-6113-4ffc-b23e-eae55d6e65a1 req-91ef58aa-1068-4dc8-8a69-f416848b1612 service nova] Creating event network-changed:d2d16c3a-ab38-4e7c-98b2-a43d2b35343b for instance 6b8b5bee-fd07-4dda-8996-a2d4099c151c on hv-cinder-83090 May 04 19:09:14.561854 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-f05c3861-6113-4ffc-b23e-eae55d6e65a1 req-91ef58aa-1068-4dc8-8a69-f416848b1612 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032206 May 04 19:09:14.563021 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 235/465] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:09:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:09:15.105449 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-89f32eaa-4374-4543-8003-da8af3307c76 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:15.106078 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-89f32eaa-4374-4543-8003-da8af3307c76 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] [instance: 6b8b5bee-fd07-4dda-8996-a2d4099c151c] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:15.114081 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-89f32eaa-4374-4543-8003-da8af3307c76 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:15.114646 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-89f32eaa-4374-4543-8003-da8af3307c76 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:15.115424 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-89f32eaa-4374-4543-8003-da8af3307c76 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:15.118147 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-89f32eaa-4374-4543-8003-da8af3307c76 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:15.126612 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-068df444-8048-40ee-8de6-55346c5fadb8 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:15.129423 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-068df444-8048-40ee-8de6-55346c5fadb8 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:15.149694 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-068df444-8048-40ee-8de6-55346c5fadb8 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:15.150495 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-068df444-8048-40ee-8de6-55346c5fadb8 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:15.151508 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-068df444-8048-40ee-8de6-55346c5fadb8 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:15.152712 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-068df444-8048-40ee-8de6-55346c5fadb8 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:15.420884 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-89f32eaa-4374-4543-8003-da8af3307c76 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632af5ddc209419a93461afdb070fc87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedb3ef21b1e413395b1a4cdcfb3f4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:15.429147 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-89f32eaa-4374-4543-8003-da8af3307c76 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] 10.222.0.69 "GET /compute/v2.1/servers/6b8b5bee-fd07-4dda-8996-a2d4099c151c" status: 200 len: 1319 microversion: 2.1 time: 0.326767 May 04 19:09:15.430017 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 231/466] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:09:15 2022] GET /compute/v2.1/servers/6b8b5bee-fd07-4dda-8996-a2d4099c151c => generated 1319 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:09:15.548343 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-068df444-8048-40ee-8de6-55346c5fadb8 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:15.557136 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-068df444-8048-40ee-8de6-55346c5fadb8 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:15.558660 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-068df444-8048-40ee-8de6-55346c5fadb8 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:15.559816 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-068df444-8048-40ee-8de6-55346c5fadb8 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1809 microversion: 2.20 time: 0.440309 May 04 19:09:15.560373 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 236/467] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:09:15 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1809 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:09:15.673593 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-58551024-a0b6-4a07-bedf-bac4138785d1 req-85f5b371-05a1-49a1-af44-23d03ca1d9c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17de0a81-ab42-475e-b6f3-dd853adc826c", "tag": "e11de5fb-b02b-4516-8fa9-a612b9b432a0"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:09:15.681925 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-58551024-a0b6-4a07-bedf-bac4138785d1 req-85f5b371-05a1-49a1-af44-23d03ca1d9c5 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:15.682759 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-58551024-a0b6-4a07-bedf-bac4138785d1 req-85f5b371-05a1-49a1-af44-23d03ca1d9c5 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:15.693150 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-58551024-a0b6-4a07-bedf-bac4138785d1 req-85f5b371-05a1-49a1-af44-23d03ca1d9c5 service nova] Creating event network-changed:e11de5fb-b02b-4516-8fa9-a612b9b432a0 for instance 17de0a81-ab42-475e-b6f3-dd853adc826c on hv-cinder-83090 May 04 19:09:15.698727 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-58551024-a0b6-4a07-bedf-bac4138785d1 req-85f5b371-05a1-49a1-af44-23d03ca1d9c5 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028878 May 04 19:09:15.699526 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 232/468] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:09:15.830672 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-b34a45da-5d7e-4da7-94db-9f9e3b40a2fd tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1982282611", "imageRef": "2869595e-cda4-45af-aaeb-0779eb5f4114", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "52743f3b-665f-4119-9451-8ab735a2cc02"}], "security_groups": [{"name": "tempest-securitygroup--1496823187"}], "key_name": "tempest-keypair-1531871535", "user_data": "}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:09:15.931049 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.network.neutron [None req-b34a45da-5d7e-4da7-94db-9f9e3b40a2fd tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] validate_networks() for [('52743f3b-665f-4119-9451-8ab735a2cc02', None, None, None, None, None)] {{(pid=117124) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 04 19:09:16.293407 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-b34a45da-5d7e-4da7-94db-9f9e3b40a2fd tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Flavor limits 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 04 19:09:16.294002 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-b34a45da-5d7e-4da7-94db-9f9e3b40a2fd tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Image limits 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 04 19:09:16.294324 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-b34a45da-5d7e-4da7-94db-9f9e3b40a2fd tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Flavor pref 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 04 19:09:16.294732 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-b34a45da-5d7e-4da7-94db-9f9e3b40a2fd tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Image pref 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 04 19:09:16.295148 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-b34a45da-5d7e-4da7-94db-9f9e3b40a2fd tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 04 19:09:16.303730 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b34a45da-5d7e-4da7-94db-9f9e3b40a2fd tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:16.304179 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b34a45da-5d7e-4da7-94db-9f9e3b40a2fd tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:16.304978 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b34a45da-5d7e-4da7-94db-9f9e3b40a2fd tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:16.305416 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b34a45da-5d7e-4da7-94db-9f9e3b40a2fd tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:16.322334 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-b34a45da-5d7e-4da7-94db-9f9e3b40a2fd tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Getting quotas for project ef1ba9318cf84308a3ff6ce6da85755d. Resources: {'cores', 'ram', 'instances'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 04 19:09:16.326234 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-b34a45da-5d7e-4da7-94db-9f9e3b40a2fd tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Getting quotas for user 98211cfafca84542a64f8b3f0b34303b and project ef1ba9318cf84308a3ff6ce6da85755d. Resources: {'cores', 'ram', 'instances'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 04 19:09:16.339965 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-b34a45da-5d7e-4da7-94db-9f9e3b40a2fd tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Going to run 1 instances... {{(pid=117124) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 04 19:09:16.342257 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-b34a45da-5d7e-4da7-94db-9f9e3b40a2fd tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 50e3af6c-83e8-4320-8157-06ed4ef20cda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2869595e-cda4-45af-aaeb-0779eb5f4114',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 04 19:09:16.390770 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-b34a45da-5d7e-4da7-94db-9f9e3b40a2fd tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.564325 May 04 19:09:16.391585 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 237/469] 10.222.0.69 () {60 vars in 1146 bytes} [Wed May 4 19:09:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 04 19:09:16.404913 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-906b122f-beea-4a7a-a3be-f19b9bc2bf90 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:16.405728 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-906b122f-beea-4a7a-a3be-f19b9bc2bf90 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 50e3af6c-83e8-4320-8157-06ed4ef20cda] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:16.451319 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-0fd2b568-7044-4949-8037-4045cae98f21 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:16.452596 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-0fd2b568-7044-4949-8037-4045cae98f21 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] [instance: 6b8b5bee-fd07-4dda-8996-a2d4099c151c] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:16.467896 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0fd2b568-7044-4949-8037-4045cae98f21 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:16.468362 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0fd2b568-7044-4949-8037-4045cae98f21 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:16.470818 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0fd2b568-7044-4949-8037-4045cae98f21 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:16.472329 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0fd2b568-7044-4949-8037-4045cae98f21 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:16.551050 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-906b122f-beea-4a7a-a3be-f19b9bc2bf90 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:16.559745 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-906b122f-beea-4a7a-a3be-f19b9bc2bf90 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/50e3af6c-83e8-4320-8157-06ed4ef20cda" status: 200 len: 1242 microversion: 2.1 time: 0.159177 May 04 19:09:16.560886 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 233/470] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:09:16 2022] GET /compute/v2.1/servers/50e3af6c-83e8-4320-8157-06ed4ef20cda => generated 1242 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:09:16.578057 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-75240066-9d85-481e-8e00-2b5e50a8b8aa tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:16.578790 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-75240066-9d85-481e-8e00-2b5e50a8b8aa tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:16.588196 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-75240066-9d85-481e-8e00-2b5e50a8b8aa tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:16.588744 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-75240066-9d85-481e-8e00-2b5e50a8b8aa tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:16.599858 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-75240066-9d85-481e-8e00-2b5e50a8b8aa tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:16.600605 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-75240066-9d85-481e-8e00-2b5e50a8b8aa tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:16.780271 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-0fd2b568-7044-4949-8037-4045cae98f21 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632af5ddc209419a93461afdb070fc87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedb3ef21b1e413395b1a4cdcfb3f4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:16.790916 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-0fd2b568-7044-4949-8037-4045cae98f21 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] 10.222.0.69 "GET /compute/v2.1/servers/6b8b5bee-fd07-4dda-8996-a2d4099c151c" status: 200 len: 1319 microversion: 2.1 time: 0.348152 May 04 19:09:16.794436 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 238/471] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:09:16 2022] GET /compute/v2.1/servers/6b8b5bee-fd07-4dda-8996-a2d4099c151c => generated 1319 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:09:16.871434 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-75240066-9d85-481e-8e00-2b5e50a8b8aa tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:16.879801 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-75240066-9d85-481e-8e00-2b5e50a8b8aa tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:16.881294 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-75240066-9d85-481e-8e00-2b5e50a8b8aa tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:16.882509 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-75240066-9d85-481e-8e00-2b5e50a8b8aa tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1809 microversion: 2.20 time: 0.308267 May 04 19:09:16.883069 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 234/472] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:09:16 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1809 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 04 19:09:17.578520 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-a65d09c1-9351-46d2-ad7d-feaa68a1d927 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:17.579162 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-a65d09c1-9351-46d2-ad7d-feaa68a1d927 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 50e3af6c-83e8-4320-8157-06ed4ef20cda] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:17.585452 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a65d09c1-9351-46d2-ad7d-feaa68a1d927 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:17.586225 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a65d09c1-9351-46d2-ad7d-feaa68a1d927 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:17.586993 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a65d09c1-9351-46d2-ad7d-feaa68a1d927 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:17.587431 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a65d09c1-9351-46d2-ad7d-feaa68a1d927 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:17.679043 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-a65d09c1-9351-46d2-ad7d-feaa68a1d927 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:17.688131 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-a65d09c1-9351-46d2-ad7d-feaa68a1d927 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/50e3af6c-83e8-4320-8157-06ed4ef20cda" status: 200 len: 1246 microversion: 2.1 time: 0.113512 May 04 19:09:17.697656 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 239/473] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:09:17 2022] GET /compute/v2.1/servers/50e3af6c-83e8-4320-8157-06ed4ef20cda => generated 1246 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:09:17.810211 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-869cafed-80a2-42ad-a80d-4262fe08c0c9 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:17.811209 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-869cafed-80a2-42ad-a80d-4262fe08c0c9 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] [instance: 6b8b5bee-fd07-4dda-8996-a2d4099c151c] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:17.818079 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-869cafed-80a2-42ad-a80d-4262fe08c0c9 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:17.818532 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-869cafed-80a2-42ad-a80d-4262fe08c0c9 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:17.819333 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-869cafed-80a2-42ad-a80d-4262fe08c0c9 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:17.819768 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-869cafed-80a2-42ad-a80d-4262fe08c0c9 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:17.901268 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-daf33c00-d85b-486a-b7f2-2b832b285a79 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:17.903186 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-daf33c00-d85b-486a-b7f2-2b832b285a79 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:17.909313 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-daf33c00-d85b-486a-b7f2-2b832b285a79 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:17.910274 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-daf33c00-d85b-486a-b7f2-2b832b285a79 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:17.911914 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-daf33c00-d85b-486a-b7f2-2b832b285a79 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:17.912375 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-daf33c00-d85b-486a-b7f2-2b832b285a79 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:18.124635 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-daf33c00-d85b-486a-b7f2-2b832b285a79 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:18.133587 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-daf33c00-d85b-486a-b7f2-2b832b285a79 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:18.135129 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-daf33c00-d85b-486a-b7f2-2b832b285a79 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:18.136346 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-daf33c00-d85b-486a-b7f2-2b832b285a79 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1809 microversion: 2.20 time: 0.239819 May 04 19:09:18.136908 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 240/474] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:09:17 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1809 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 04 19:09:18.285197 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-869cafed-80a2-42ad-a80d-4262fe08c0c9 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632af5ddc209419a93461afdb070fc87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedb3ef21b1e413395b1a4cdcfb3f4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:18.292563 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-869cafed-80a2-42ad-a80d-4262fe08c0c9 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] 10.222.0.69 "GET /compute/v2.1/servers/6b8b5bee-fd07-4dda-8996-a2d4099c151c" status: 200 len: 1319 microversion: 2.1 time: 0.486267 May 04 19:09:18.293131 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 235/475] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:09:17 2022] GET /compute/v2.1/servers/6b8b5bee-fd07-4dda-8996-a2d4099c151c => generated 1319 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:09:18.705823 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-3215b380-6da5-4076-839d-64bce7344c26 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:18.706461 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-3215b380-6da5-4076-839d-64bce7344c26 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 50e3af6c-83e8-4320-8157-06ed4ef20cda] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:18.712955 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3215b380-6da5-4076-839d-64bce7344c26 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:18.713398 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3215b380-6da5-4076-839d-64bce7344c26 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:18.714253 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3215b380-6da5-4076-839d-64bce7344c26 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:18.714685 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3215b380-6da5-4076-839d-64bce7344c26 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:18.774907 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-3215b380-6da5-4076-839d-64bce7344c26 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:18.782049 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-3215b380-6da5-4076-839d-64bce7344c26 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/50e3af6c-83e8-4320-8157-06ed4ef20cda" status: 200 len: 1300 microversion: 2.1 time: 0.080115 May 04 19:09:18.782609 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 241/476] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:09:18 2022] GET /compute/v2.1/servers/50e3af6c-83e8-4320-8157-06ed4ef20cda => generated 1300 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:09:19.155163 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-3ad1db04-8e40-43f6-bb86-bab59b468a8b tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:19.155796 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-3ad1db04-8e40-43f6-bb86-bab59b468a8b tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:19.162292 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3ad1db04-8e40-43f6-bb86-bab59b468a8b tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:19.163234 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3ad1db04-8e40-43f6-bb86-bab59b468a8b tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:19.163985 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3ad1db04-8e40-43f6-bb86-bab59b468a8b tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:19.164418 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3ad1db04-8e40-43f6-bb86-bab59b468a8b tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:19.309194 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-3ad1db04-8e40-43f6-bb86-bab59b468a8b tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:19.309449 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-cfd64e3d-51e0-4f28-8448-6ee3a0d72430 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:19.310096 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-cfd64e3d-51e0-4f28-8448-6ee3a0d72430 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] [instance: 6b8b5bee-fd07-4dda-8996-a2d4099c151c] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:19.319997 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-cfd64e3d-51e0-4f28-8448-6ee3a0d72430 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:19.320717 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-3ad1db04-8e40-43f6-bb86-bab59b468a8b tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:19.321115 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-cfd64e3d-51e0-4f28-8448-6ee3a0d72430 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:19.322327 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-3ad1db04-8e40-43f6-bb86-bab59b468a8b tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:19.323347 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-cfd64e3d-51e0-4f28-8448-6ee3a0d72430 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:19.324711 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-cfd64e3d-51e0-4f28-8448-6ee3a0d72430 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:19.326177 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-3ad1db04-8e40-43f6-bb86-bab59b468a8b tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1809 microversion: 2.20 time: 0.175028 May 04 19:09:19.328812 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 236/477] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:09:19 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:09:19.544920 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-cfd64e3d-51e0-4f28-8448-6ee3a0d72430 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632af5ddc209419a93461afdb070fc87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedb3ef21b1e413395b1a4cdcfb3f4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:19.555618 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-cfd64e3d-51e0-4f28-8448-6ee3a0d72430 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] 10.222.0.69 "GET /compute/v2.1/servers/6b8b5bee-fd07-4dda-8996-a2d4099c151c" status: 200 len: 1319 microversion: 2.1 time: 0.249814 May 04 19:09:19.556715 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 242/478] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:09:19 2022] GET /compute/v2.1/servers/6b8b5bee-fd07-4dda-8996-a2d4099c151c => generated 1319 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:09:19.799424 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-e7064b3f-6314-4442-a324-f3a4dc74b2a2 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:19.800034 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-e7064b3f-6314-4442-a324-f3a4dc74b2a2 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 50e3af6c-83e8-4320-8157-06ed4ef20cda] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:19.806959 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e7064b3f-6314-4442-a324-f3a4dc74b2a2 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:19.807081 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e7064b3f-6314-4442-a324-f3a4dc74b2a2 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:19.807816 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e7064b3f-6314-4442-a324-f3a4dc74b2a2 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:19.808248 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e7064b3f-6314-4442-a324-f3a4dc74b2a2 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:19.958218 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-e7064b3f-6314-4442-a324-f3a4dc74b2a2 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:19.965597 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-e7064b3f-6314-4442-a324-f3a4dc74b2a2 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/50e3af6c-83e8-4320-8157-06ed4ef20cda" status: 200 len: 1368 microversion: 2.1 time: 0.169874 May 04 19:09:19.966168 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 237/479] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:09:19 2022] GET /compute/v2.1/servers/50e3af6c-83e8-4320-8157-06ed4ef20cda => generated 1368 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:09:20.344930 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-5bb9f76f-6455-4b04-965a-2e78e6872356 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:20.346419 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-5bb9f76f-6455-4b04-965a-2e78e6872356 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:20.355745 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5bb9f76f-6455-4b04-965a-2e78e6872356 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:20.356323 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5bb9f76f-6455-4b04-965a-2e78e6872356 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:20.359300 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5bb9f76f-6455-4b04-965a-2e78e6872356 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:20.361600 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5bb9f76f-6455-4b04-965a-2e78e6872356 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:20.568204 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-5bb9f76f-6455-4b04-965a-2e78e6872356 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:20.573275 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-c4838368-ce67-4cdc-aefc-120d1a3bc14c tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:20.574156 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-c4838368-ce67-4cdc-aefc-120d1a3bc14c tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] [instance: 6b8b5bee-fd07-4dda-8996-a2d4099c151c] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:20.577719 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-5bb9f76f-6455-4b04-965a-2e78e6872356 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:20.579510 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-5bb9f76f-6455-4b04-965a-2e78e6872356 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:20.580874 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-5bb9f76f-6455-4b04-965a-2e78e6872356 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1809 microversion: 2.20 time: 0.240377 May 04 19:09:20.581832 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c4838368-ce67-4cdc-aefc-120d1a3bc14c tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:20.581974 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 243/480] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:09:20 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1809 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:09:20.582076 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c4838368-ce67-4cdc-aefc-120d1a3bc14c tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:20.582775 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c4838368-ce67-4cdc-aefc-120d1a3bc14c tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:20.583297 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c4838368-ce67-4cdc-aefc-120d1a3bc14c tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:20.626899 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-6ef779cf-9860-4a9d-878e-87271fd04b60 req-2bad3a1a-28a7-4785-9e26-503a36f0c880 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50e3af6c-83e8-4320-8157-06ed4ef20cda", "tag": "f03e3054-1bc8-4f86-b799-59096192f4ee"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:09:20.638152 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-6ef779cf-9860-4a9d-878e-87271fd04b60 req-2bad3a1a-28a7-4785-9e26-503a36f0c880 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:20.639011 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-6ef779cf-9860-4a9d-878e-87271fd04b60 req-2bad3a1a-28a7-4785-9e26-503a36f0c880 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:20.662355 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-6ef779cf-9860-4a9d-878e-87271fd04b60 req-2bad3a1a-28a7-4785-9e26-503a36f0c880 service nova] Creating event network-changed:f03e3054-1bc8-4f86-b799-59096192f4ee for instance 50e3af6c-83e8-4320-8157-06ed4ef20cda on hv-cinder-83090 May 04 19:09:20.669274 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-6ef779cf-9860-4a9d-878e-87271fd04b60 req-2bad3a1a-28a7-4785-9e26-503a36f0c880 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047569 May 04 19:09:20.670014 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 244/481] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 04 19:09:20.738498 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-c4838368-ce67-4cdc-aefc-120d1a3bc14c tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632af5ddc209419a93461afdb070fc87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedb3ef21b1e413395b1a4cdcfb3f4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:20.746244 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-c4838368-ce67-4cdc-aefc-120d1a3bc14c tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] 10.222.0.69 "GET /compute/v2.1/servers/6b8b5bee-fd07-4dda-8996-a2d4099c151c" status: 200 len: 1319 microversion: 2.1 time: 0.176845 May 04 19:09:20.746920 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 238/482] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:09:20 2022] GET /compute/v2.1/servers/6b8b5bee-fd07-4dda-8996-a2d4099c151c => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:09:20.982545 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-6b72047b-411d-4b58-856d-660b610998cc tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:20.983246 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-6b72047b-411d-4b58-856d-660b610998cc tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 50e3af6c-83e8-4320-8157-06ed4ef20cda] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:20.989341 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6b72047b-411d-4b58-856d-660b610998cc tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:20.989823 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6b72047b-411d-4b58-856d-660b610998cc tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:20.990601 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6b72047b-411d-4b58-856d-660b610998cc tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:20.991062 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6b72047b-411d-4b58-856d-660b610998cc tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:21.157527 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-6b72047b-411d-4b58-856d-660b610998cc tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:21.165435 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-6b72047b-411d-4b58-856d-660b610998cc tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/50e3af6c-83e8-4320-8157-06ed4ef20cda" status: 200 len: 1368 microversion: 2.1 time: 0.187304 May 04 19:09:21.166023 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 245/483] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:09:20 2022] GET /compute/v2.1/servers/50e3af6c-83e8-4320-8157-06ed4ef20cda => generated 1368 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:09:21.599895 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-fab871ea-7056-4b40-9bc0-07f70805fdec tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:21.600979 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-fab871ea-7056-4b40-9bc0-07f70805fdec tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:21.607397 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-fab871ea-7056-4b40-9bc0-07f70805fdec tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:21.607841 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-fab871ea-7056-4b40-9bc0-07f70805fdec tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:21.608619 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-fab871ea-7056-4b40-9bc0-07f70805fdec tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:21.609048 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-fab871ea-7056-4b40-9bc0-07f70805fdec tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:21.732545 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-fab871ea-7056-4b40-9bc0-07f70805fdec tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:21.741276 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-fab871ea-7056-4b40-9bc0-07f70805fdec tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:21.742816 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-fab871ea-7056-4b40-9bc0-07f70805fdec tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:21.743944 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-fab871ea-7056-4b40-9bc0-07f70805fdec tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1809 microversion: 2.20 time: 0.147964 May 04 19:09:21.744500 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 239/484] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:09:21 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1809 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:09:21.762918 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-4f474626-85b3-41f0-a268-35b75248fe75 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:21.763523 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-4f474626-85b3-41f0-a268-35b75248fe75 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] [instance: 6b8b5bee-fd07-4dda-8996-a2d4099c151c] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:21.769952 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4f474626-85b3-41f0-a268-35b75248fe75 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:21.770397 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4f474626-85b3-41f0-a268-35b75248fe75 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:21.771158 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4f474626-85b3-41f0-a268-35b75248fe75 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:21.771587 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4f474626-85b3-41f0-a268-35b75248fe75 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:21.893606 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-4f474626-85b3-41f0-a268-35b75248fe75 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632af5ddc209419a93461afdb070fc87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedb3ef21b1e413395b1a4cdcfb3f4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:21.901248 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-4f474626-85b3-41f0-a268-35b75248fe75 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] 10.222.0.69 "GET /compute/v2.1/servers/6b8b5bee-fd07-4dda-8996-a2d4099c151c" status: 200 len: 1319 microversion: 2.1 time: 0.142090 May 04 19:09:21.901847 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 246/485] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:09:21 2022] GET /compute/v2.1/servers/6b8b5bee-fd07-4dda-8996-a2d4099c151c => generated 1319 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:09:22.119666 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-748d937d-65ff-4101-9963-edc8488179de req-6fffe35c-7894-4a6a-b3c0-a24f7535c6dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f929e9e-51bf-477a-877b-6c162202c7f5", "name": "network-vif-plugged", "status": "completed", "tag": "c2916343-9825-41ef-93c5-4b2dbc6d65a9"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:09:22.127585 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-748d937d-65ff-4101-9963-edc8488179de req-6fffe35c-7894-4a6a-b3c0-a24f7535c6dd service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:22.128027 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-748d937d-65ff-4101-9963-edc8488179de req-6fffe35c-7894-4a6a-b3c0-a24f7535c6dd service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:22.138874 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-748d937d-65ff-4101-9963-edc8488179de req-6fffe35c-7894-4a6a-b3c0-a24f7535c6dd service nova] Creating event network-vif-plugged:c2916343-9825-41ef-93c5-4b2dbc6d65a9 for instance 8f929e9e-51bf-477a-877b-6c162202c7f5 on hv-cinder-83090 May 04 19:09:22.144096 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-748d937d-65ff-4101-9963-edc8488179de req-6fffe35c-7894-4a6a-b3c0-a24f7535c6dd service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028141 May 04 19:09:22.144677 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 240/486] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:09:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:09:22.181844 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-b5db219b-0eea-4234-bc5c-04bdb87eb2ed tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:22.182459 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-b5db219b-0eea-4234-bc5c-04bdb87eb2ed tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 50e3af6c-83e8-4320-8157-06ed4ef20cda] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:22.188381 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b5db219b-0eea-4234-bc5c-04bdb87eb2ed tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:22.188832 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b5db219b-0eea-4234-bc5c-04bdb87eb2ed tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:22.189624 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b5db219b-0eea-4234-bc5c-04bdb87eb2ed tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:22.190064 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b5db219b-0eea-4234-bc5c-04bdb87eb2ed tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:22.322113 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-b5db219b-0eea-4234-bc5c-04bdb87eb2ed tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:22.329344 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-b5db219b-0eea-4234-bc5c-04bdb87eb2ed tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/50e3af6c-83e8-4320-8157-06ed4ef20cda" status: 200 len: 1368 microversion: 2.1 time: 0.151378 May 04 19:09:22.329950 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 247/487] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:09:22 2022] GET /compute/v2.1/servers/50e3af6c-83e8-4320-8157-06ed4ef20cda => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:09:22.763077 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-d94ad668-e40c-4bbe-989c-70e76ff53175 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:22.763746 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-d94ad668-e40c-4bbe-989c-70e76ff53175 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:22.770282 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d94ad668-e40c-4bbe-989c-70e76ff53175 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:22.770729 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d94ad668-e40c-4bbe-989c-70e76ff53175 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:22.771503 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d94ad668-e40c-4bbe-989c-70e76ff53175 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:22.772435 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d94ad668-e40c-4bbe-989c-70e76ff53175 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:22.917620 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-d94ad668-e40c-4bbe-989c-70e76ff53175 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:22.920128 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-d6381fdc-9b1c-4ac0-b5e7-ba88f63fb768 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:22.920887 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-d6381fdc-9b1c-4ac0-b5e7-ba88f63fb768 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] [instance: 6b8b5bee-fd07-4dda-8996-a2d4099c151c] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:22.928235 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-d94ad668-e40c-4bbe-989c-70e76ff53175 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:22.928716 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d6381fdc-9b1c-4ac0-b5e7-ba88f63fb768 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:22.929165 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d6381fdc-9b1c-4ac0-b5e7-ba88f63fb768 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:22.930239 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d6381fdc-9b1c-4ac0-b5e7-ba88f63fb768 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:22.930818 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d6381fdc-9b1c-4ac0-b5e7-ba88f63fb768 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:22.931061 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-d94ad668-e40c-4bbe-989c-70e76ff53175 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:22.932440 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-d94ad668-e40c-4bbe-989c-70e76ff53175 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1809 microversion: 2.20 time: 0.174197 May 04 19:09:22.934190 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 241/488] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:09:22 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 04 19:09:23.091288 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-d6381fdc-9b1c-4ac0-b5e7-ba88f63fb768 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632af5ddc209419a93461afdb070fc87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedb3ef21b1e413395b1a4cdcfb3f4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:23.098477 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-d6381fdc-9b1c-4ac0-b5e7-ba88f63fb768 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] 10.222.0.69 "GET /compute/v2.1/servers/6b8b5bee-fd07-4dda-8996-a2d4099c151c" status: 200 len: 1319 microversion: 2.1 time: 0.183800 May 04 19:09:23.099050 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 248/489] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:09:22 2022] GET /compute/v2.1/servers/6b8b5bee-fd07-4dda-8996-a2d4099c151c => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:09:23.346548 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-21e1939c-bafe-4c70-b4ed-63705cb01a9a tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:23.347155 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-21e1939c-bafe-4c70-b4ed-63705cb01a9a tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 50e3af6c-83e8-4320-8157-06ed4ef20cda] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:23.352838 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-21e1939c-bafe-4c70-b4ed-63705cb01a9a tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:23.353279 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-21e1939c-bafe-4c70-b4ed-63705cb01a9a tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:23.354065 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-21e1939c-bafe-4c70-b4ed-63705cb01a9a tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:23.354493 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-21e1939c-bafe-4c70-b4ed-63705cb01a9a tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:23.481615 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-21e1939c-bafe-4c70-b4ed-63705cb01a9a tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:23.488836 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-21e1939c-bafe-4c70-b4ed-63705cb01a9a tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/50e3af6c-83e8-4320-8157-06ed4ef20cda" status: 200 len: 1368 microversion: 2.1 time: 0.146036 May 04 19:09:23.489390 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 242/490] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:09:23 2022] GET /compute/v2.1/servers/50e3af6c-83e8-4320-8157-06ed4ef20cda => generated 1368 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:09:23.951307 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-115f38cd-d95c-47de-a25d-3eca13ad5ffb tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:23.951901 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-115f38cd-d95c-47de-a25d-3eca13ad5ffb tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:23.959628 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-115f38cd-d95c-47de-a25d-3eca13ad5ffb tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:23.960086 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-115f38cd-d95c-47de-a25d-3eca13ad5ffb tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:23.960874 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-115f38cd-d95c-47de-a25d-3eca13ad5ffb tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:23.961561 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-115f38cd-d95c-47de-a25d-3eca13ad5ffb tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:24.099598 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-115f38cd-d95c-47de-a25d-3eca13ad5ffb tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:24.108330 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-115f38cd-d95c-47de-a25d-3eca13ad5ffb tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:24.109878 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-115f38cd-d95c-47de-a25d-3eca13ad5ffb tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:24.111043 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-115f38cd-d95c-47de-a25d-3eca13ad5ffb tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1809 microversion: 2.20 time: 0.163712 May 04 19:09:24.111591 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 249/491] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:09:23 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:09:24.115449 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-c434f93b-9803-4f09-a429-f326ac260cb3 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:24.116162 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-c434f93b-9803-4f09-a429-f326ac260cb3 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] [instance: 6b8b5bee-fd07-4dda-8996-a2d4099c151c] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:24.122535 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c434f93b-9803-4f09-a429-f326ac260cb3 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:24.122978 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c434f93b-9803-4f09-a429-f326ac260cb3 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:24.123743 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c434f93b-9803-4f09-a429-f326ac260cb3 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:24.124177 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c434f93b-9803-4f09-a429-f326ac260cb3 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:24.175119 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-1df9cae9-535c-4145-8b16-d1e76426ed34 req-1bca1710-44ad-465b-b14b-0641b7a2d54d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b8b5bee-fd07-4dda-8996-a2d4099c151c", "name": "network-vif-plugged", "status": "completed", "tag": "d2d16c3a-ab38-4e7c-98b2-a43d2b35343b"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:09:24.183558 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-1df9cae9-535c-4145-8b16-d1e76426ed34 req-1bca1710-44ad-465b-b14b-0641b7a2d54d service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:24.184003 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-1df9cae9-535c-4145-8b16-d1e76426ed34 req-1bca1710-44ad-465b-b14b-0641b7a2d54d service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:24.195153 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-1df9cae9-535c-4145-8b16-d1e76426ed34 req-1bca1710-44ad-465b-b14b-0641b7a2d54d service nova] Creating event network-vif-plugged:d2d16c3a-ab38-4e7c-98b2-a43d2b35343b for instance 6b8b5bee-fd07-4dda-8996-a2d4099c151c on hv-cinder-83090 May 04 19:09:24.200006 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-1df9cae9-535c-4145-8b16-d1e76426ed34 req-1bca1710-44ad-465b-b14b-0641b7a2d54d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028769 May 04 19:09:24.200933 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 250/492] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:09:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 04 19:09:24.259507 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-c434f93b-9803-4f09-a429-f326ac260cb3 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632af5ddc209419a93461afdb070fc87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedb3ef21b1e413395b1a4cdcfb3f4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:24.272567 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-c434f93b-9803-4f09-a429-f326ac260cb3 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] 10.222.0.69 "GET /compute/v2.1/servers/6b8b5bee-fd07-4dda-8996-a2d4099c151c" status: 200 len: 1319 microversion: 2.1 time: 0.160584 May 04 19:09:24.273155 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 243/493] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:09:24 2022] GET /compute/v2.1/servers/6b8b5bee-fd07-4dda-8996-a2d4099c151c => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:09:24.507057 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-71ee7001-a0c9-481d-b109-e87985bad6e8 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:24.507685 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-71ee7001-a0c9-481d-b109-e87985bad6e8 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 50e3af6c-83e8-4320-8157-06ed4ef20cda] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:24.513872 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-71ee7001-a0c9-481d-b109-e87985bad6e8 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:24.514324 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-71ee7001-a0c9-481d-b109-e87985bad6e8 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:24.515077 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-71ee7001-a0c9-481d-b109-e87985bad6e8 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:24.515509 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-71ee7001-a0c9-481d-b109-e87985bad6e8 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:24.652323 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-71ee7001-a0c9-481d-b109-e87985bad6e8 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:24.659666 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-71ee7001-a0c9-481d-b109-e87985bad6e8 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/50e3af6c-83e8-4320-8157-06ed4ef20cda" status: 200 len: 1368 microversion: 2.1 time: 0.157411 May 04 19:09:24.660229 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 251/494] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:09:24 2022] GET /compute/v2.1/servers/50e3af6c-83e8-4320-8157-06ed4ef20cda => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:09:25.128040 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-3d51f66c-afa1-49b2-afd3-5e558149cdb1 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:25.128656 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-3d51f66c-afa1-49b2-afd3-5e558149cdb1 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:25.135651 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3d51f66c-afa1-49b2-afd3-5e558149cdb1 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:25.136207 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3d51f66c-afa1-49b2-afd3-5e558149cdb1 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:25.137041 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3d51f66c-afa1-49b2-afd3-5e558149cdb1 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:25.137505 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3d51f66c-afa1-49b2-afd3-5e558149cdb1 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:25.269096 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-3d51f66c-afa1-49b2-afd3-5e558149cdb1 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:25.277996 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-3d51f66c-afa1-49b2-afd3-5e558149cdb1 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:25.279513 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-3d51f66c-afa1-49b2-afd3-5e558149cdb1 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:25.280683 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-3d51f66c-afa1-49b2-afd3-5e558149cdb1 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1809 microversion: 2.20 time: 0.156574 May 04 19:09:25.281242 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 244/495] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:09:25 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:09:25.292591 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-6015ebc7-52e7-448b-ae98-15376fbf2a6e tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:25.293358 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-6015ebc7-52e7-448b-ae98-15376fbf2a6e tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] [instance: 6b8b5bee-fd07-4dda-8996-a2d4099c151c] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:25.299997 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6015ebc7-52e7-448b-ae98-15376fbf2a6e tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:25.300445 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6015ebc7-52e7-448b-ae98-15376fbf2a6e tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:25.301211 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6015ebc7-52e7-448b-ae98-15376fbf2a6e tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:25.301675 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6015ebc7-52e7-448b-ae98-15376fbf2a6e tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:25.433107 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-6015ebc7-52e7-448b-ae98-15376fbf2a6e tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632af5ddc209419a93461afdb070fc87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedb3ef21b1e413395b1a4cdcfb3f4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:25.440775 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-6015ebc7-52e7-448b-ae98-15376fbf2a6e tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] 10.222.0.69 "GET /compute/v2.1/servers/6b8b5bee-fd07-4dda-8996-a2d4099c151c" status: 200 len: 1319 microversion: 2.1 time: 0.152043 May 04 19:09:25.449722 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 252/496] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:09:25 2022] GET /compute/v2.1/servers/6b8b5bee-fd07-4dda-8996-a2d4099c151c => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:09:25.676249 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-966d48a0-66d5-4e04-9877-c2c8b291d03e tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:25.676860 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-966d48a0-66d5-4e04-9877-c2c8b291d03e tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 50e3af6c-83e8-4320-8157-06ed4ef20cda] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:25.682910 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-966d48a0-66d5-4e04-9877-c2c8b291d03e tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:25.683366 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-966d48a0-66d5-4e04-9877-c2c8b291d03e tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:25.684127 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-966d48a0-66d5-4e04-9877-c2c8b291d03e tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:25.684562 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-966d48a0-66d5-4e04-9877-c2c8b291d03e tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:25.807403 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-966d48a0-66d5-4e04-9877-c2c8b291d03e tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:25.814611 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-966d48a0-66d5-4e04-9877-c2c8b291d03e tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/50e3af6c-83e8-4320-8157-06ed4ef20cda" status: 200 len: 1368 microversion: 2.1 time: 0.142178 May 04 19:09:25.815160 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 245/497] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:09:25 2022] GET /compute/v2.1/servers/50e3af6c-83e8-4320-8157-06ed4ef20cda => generated 1368 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:09:26.214732 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-8039de01-1c31-49d2-85ed-05329c49ba65 req-e7b304fd-6321-4c28-9cbb-485b1a9ffaa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50e3af6c-83e8-4320-8157-06ed4ef20cda", "name": "network-vif-plugged", "status": "completed", "tag": "f03e3054-1bc8-4f86-b799-59096192f4ee"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:09:26.222833 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-8039de01-1c31-49d2-85ed-05329c49ba65 req-e7b304fd-6321-4c28-9cbb-485b1a9ffaa7 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:26.223350 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-8039de01-1c31-49d2-85ed-05329c49ba65 req-e7b304fd-6321-4c28-9cbb-485b1a9ffaa7 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:26.234968 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-8039de01-1c31-49d2-85ed-05329c49ba65 req-e7b304fd-6321-4c28-9cbb-485b1a9ffaa7 service nova] Creating event network-vif-plugged:f03e3054-1bc8-4f86-b799-59096192f4ee for instance 50e3af6c-83e8-4320-8157-06ed4ef20cda on hv-cinder-83090 May 04 19:09:26.239609 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-8039de01-1c31-49d2-85ed-05329c49ba65 req-e7b304fd-6321-4c28-9cbb-485b1a9ffaa7 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030008 May 04 19:09:26.240206 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 253/498] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:09:26.299081 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-c0c0094b-7e74-47b1-9167-39bd87080921 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:26.299696 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-c0c0094b-7e74-47b1-9167-39bd87080921 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:26.306533 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c0c0094b-7e74-47b1-9167-39bd87080921 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:26.306982 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c0c0094b-7e74-47b1-9167-39bd87080921 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:26.307775 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c0c0094b-7e74-47b1-9167-39bd87080921 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:26.308214 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c0c0094b-7e74-47b1-9167-39bd87080921 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:26.440629 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-c0c0094b-7e74-47b1-9167-39bd87080921 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:26.449569 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-c0c0094b-7e74-47b1-9167-39bd87080921 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:26.451092 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-c0c0094b-7e74-47b1-9167-39bd87080921 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:26.452247 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-c0c0094b-7e74-47b1-9167-39bd87080921 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1796 microversion: 2.20 time: 0.157069 May 04 19:09:26.452800 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 246/499] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:09:26 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1796 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:09:26.458074 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-3ac1c442-dab6-4f1e-ba7d-b7f337f07711 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:26.458772 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-3ac1c442-dab6-4f1e-ba7d-b7f337f07711 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] [instance: 6b8b5bee-fd07-4dda-8996-a2d4099c151c] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:26.464739 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3ac1c442-dab6-4f1e-ba7d-b7f337f07711 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:26.465188 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3ac1c442-dab6-4f1e-ba7d-b7f337f07711 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:26.465970 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3ac1c442-dab6-4f1e-ba7d-b7f337f07711 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:26.466402 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3ac1c442-dab6-4f1e-ba7d-b7f337f07711 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:26.593733 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-3ac1c442-dab6-4f1e-ba7d-b7f337f07711 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632af5ddc209419a93461afdb070fc87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedb3ef21b1e413395b1a4cdcfb3f4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:26.601557 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-3ac1c442-dab6-4f1e-ba7d-b7f337f07711 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] 10.222.0.69 "GET /compute/v2.1/servers/6b8b5bee-fd07-4dda-8996-a2d4099c151c" status: 200 len: 1509 microversion: 2.1 time: 0.148072 May 04 19:09:26.602119 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 254/500] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:09:26 2022] GET /compute/v2.1/servers/6b8b5bee-fd07-4dda-8996-a2d4099c151c => generated 1509 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:09:26.617650 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-fe19b4a9-c9c7-4d2a-80ce-b4375fabe3c0 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e4b60fc4-ac7e-4d70-8f85-4f2e57a49bed", "device": "/dev/sdb"}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:09:26.618796 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-fe19b4a9-c9c7-4d2a-80ce-b4375fabe3c0 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] [instance: 6b8b5bee-fd07-4dda-8996-a2d4099c151c] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:26.624635 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-fe19b4a9-c9c7-4d2a-80ce-b4375fabe3c0 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:26.625081 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-fe19b4a9-c9c7-4d2a-80ce-b4375fabe3c0 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:26.625864 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-fe19b4a9-c9c7-4d2a-80ce-b4375fabe3c0 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:26.626391 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-fe19b4a9-c9c7-4d2a-80ce-b4375fabe3c0 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:26.831054 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-cb6b9f3e-70c1-45eb-94db-c2dd79da0bce tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:26.831687 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-cb6b9f3e-70c1-45eb-94db-c2dd79da0bce tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 50e3af6c-83e8-4320-8157-06ed4ef20cda] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:26.838042 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-cb6b9f3e-70c1-45eb-94db-c2dd79da0bce tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:26.838484 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-cb6b9f3e-70c1-45eb-94db-c2dd79da0bce tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:26.839236 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-cb6b9f3e-70c1-45eb-94db-c2dd79da0bce tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:26.839671 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-cb6b9f3e-70c1-45eb-94db-c2dd79da0bce tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:26.969343 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-cb6b9f3e-70c1-45eb-94db-c2dd79da0bce tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:26.979133 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-cb6b9f3e-70c1-45eb-94db-c2dd79da0bce tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/50e3af6c-83e8-4320-8157-06ed4ef20cda" status: 200 len: 1368 microversion: 2.1 time: 0.151636 May 04 19:09:26.979935 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 255/501] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:09:26 2022] GET /compute/v2.1/servers/50e3af6c-83e8-4320-8157-06ed4ef20cda => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:09:27.165555 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-fe19b4a9-c9c7-4d2a-80ce-b4375fabe3c0 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] 10.222.0.69 "POST /compute/v2.1/servers/6b8b5bee-fd07-4dda-8996-a2d4099c151c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.551844 May 04 19:09:27.166242 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 247/502] 10.222.0.69 () {60 vars in 1322 bytes} [Wed May 4 19:09:26 2022] POST /compute/v2.1/servers/6b8b5bee-fd07-4dda-8996-a2d4099c151c/os-volume_attachments => generated 194 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:09:27.996209 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-ca78fa0d-f413-44d3-a6f6-fe9408dfbc99 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:27.996824 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-ca78fa0d-f413-44d3-a6f6-fe9408dfbc99 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 50e3af6c-83e8-4320-8157-06ed4ef20cda] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:28.002773 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ca78fa0d-f413-44d3-a6f6-fe9408dfbc99 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:28.003222 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ca78fa0d-f413-44d3-a6f6-fe9408dfbc99 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:28.003982 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ca78fa0d-f413-44d3-a6f6-fe9408dfbc99 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:28.004420 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ca78fa0d-f413-44d3-a6f6-fe9408dfbc99 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:28.126651 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-ca78fa0d-f413-44d3-a6f6-fe9408dfbc99 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:28.133854 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-ca78fa0d-f413-44d3-a6f6-fe9408dfbc99 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/50e3af6c-83e8-4320-8157-06ed4ef20cda" status: 200 len: 1368 microversion: 2.1 time: 0.141588 May 04 19:09:28.134418 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 256/503] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:09:27 2022] GET /compute/v2.1/servers/50e3af6c-83e8-4320-8157-06ed4ef20cda => generated 1368 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:09:29.151825 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-205a9545-2102-41cc-b3cd-9b908705dc00 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:29.152519 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-205a9545-2102-41cc-b3cd-9b908705dc00 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 50e3af6c-83e8-4320-8157-06ed4ef20cda] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:29.158729 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-205a9545-2102-41cc-b3cd-9b908705dc00 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:29.159178 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-205a9545-2102-41cc-b3cd-9b908705dc00 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:29.159937 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-205a9545-2102-41cc-b3cd-9b908705dc00 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:29.160373 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-205a9545-2102-41cc-b3cd-9b908705dc00 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:29.289666 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-205a9545-2102-41cc-b3cd-9b908705dc00 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:29.296856 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-205a9545-2102-41cc-b3cd-9b908705dc00 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/50e3af6c-83e8-4320-8157-06ed4ef20cda" status: 200 len: 1368 microversion: 2.1 time: 0.149781 May 04 19:09:29.297426 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 248/504] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:09:29 2022] GET /compute/v2.1/servers/50e3af6c-83e8-4320-8157-06ed4ef20cda => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:09:30.314183 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-7e36b9d7-75da-4536-8695-503ec9c52941 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:30.314800 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-7e36b9d7-75da-4536-8695-503ec9c52941 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 50e3af6c-83e8-4320-8157-06ed4ef20cda] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:30.321205 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7e36b9d7-75da-4536-8695-503ec9c52941 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:30.321687 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7e36b9d7-75da-4536-8695-503ec9c52941 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:30.322459 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7e36b9d7-75da-4536-8695-503ec9c52941 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:30.322900 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7e36b9d7-75da-4536-8695-503ec9c52941 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:30.451772 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-7e36b9d7-75da-4536-8695-503ec9c52941 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:30.458917 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-7e36b9d7-75da-4536-8695-503ec9c52941 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/50e3af6c-83e8-4320-8157-06ed4ef20cda" status: 200 len: 1558 microversion: 2.1 time: 0.148587 May 04 19:09:30.460123 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 257/505] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:09:30 2022] GET /compute/v2.1/servers/50e3af6c-83e8-4320-8157-06ed4ef20cda => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:09:30.475367 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-ad85c736-74d1-43c2-899a-2519bd258c4c tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:30.475867 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-ad85c736-74d1-43c2-899a-2519bd258c4c tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 50e3af6c-83e8-4320-8157-06ed4ef20cda] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:30.482137 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ad85c736-74d1-43c2-899a-2519bd258c4c tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:30.482582 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ad85c736-74d1-43c2-899a-2519bd258c4c tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:30.483329 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ad85c736-74d1-43c2-899a-2519bd258c4c tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:30.483760 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ad85c736-74d1-43c2-899a-2519bd258c4c tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:30.558000 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-ad85c736-74d1-43c2-899a-2519bd258c4c tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/50e3af6c-83e8-4320-8157-06ed4ef20cda/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.086358 May 04 19:09:30.558587 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 249/506] 10.222.0.69 () {58 vars in 1274 bytes} [Wed May 4 19:09:30 2022] GET /compute/v2.1/servers/50e3af6c-83e8-4320-8157-06ed4ef20cda/os-interface => generated 284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:09:31.488534 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-f4ccd111-5786-43ca-81df-e06291aa7f43 req-4bfa1dc1-9280-40b3-8b1b-261f4d186697 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50e3af6c-83e8-4320-8157-06ed4ef20cda", "tag": "f03e3054-1bc8-4f86-b799-59096192f4ee"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:09:31.497921 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-f4ccd111-5786-43ca-81df-e06291aa7f43 req-4bfa1dc1-9280-40b3-8b1b-261f4d186697 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:31.498429 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-f4ccd111-5786-43ca-81df-e06291aa7f43 req-4bfa1dc1-9280-40b3-8b1b-261f4d186697 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:31.508968 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-f4ccd111-5786-43ca-81df-e06291aa7f43 req-4bfa1dc1-9280-40b3-8b1b-261f4d186697 service nova] Creating event network-changed:f03e3054-1bc8-4f86-b799-59096192f4ee for instance 50e3af6c-83e8-4320-8157-06ed4ef20cda on hv-cinder-83090 May 04 19:09:31.513997 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-f4ccd111-5786-43ca-81df-e06291aa7f43 req-4bfa1dc1-9280-40b3-8b1b-261f4d186697 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029255 May 04 19:09:31.514575 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 258/507] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:09:43.248755 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-1be8d196-a9c5-4162-9d15-4e1d0e20d3b6 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:43.249265 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-1be8d196-a9c5-4162-9d15-4e1d0e20d3b6 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:43.255068 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1be8d196-a9c5-4162-9d15-4e1d0e20d3b6 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:43.256011 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1be8d196-a9c5-4162-9d15-4e1d0e20d3b6 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:43.256756 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1be8d196-a9c5-4162-9d15-4e1d0e20d3b6 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:43.257185 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1be8d196-a9c5-4162-9d15-4e1d0e20d3b6 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:43.332965 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.objects.instance [None req-1be8d196-a9c5-4162-9d15-4e1d0e20d3b6 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lazy-loading 'services' on Instance uuid f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d {{(pid=117125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 04 19:09:43.405403 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-1be8d196-a9c5-4162-9d15-4e1d0e20d3b6 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "DELETE /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d/os-volume_attachments/2b79ee3f-b092-4e6b-bc3e-4a8ce5fae5d0" status: 202 len: 0 microversion: 2.1 time: 0.160973 May 04 19:09:43.406012 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 250/508] 10.222.0.69 () {58 vars in 1415 bytes} [Wed May 4 19:09:43 2022] DELETE /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d/os-volume_attachments/2b79ee3f-b092-4e6b-bc3e-4a8ce5fae5d0 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 04 19:09:45.566769 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-1cb8638c-f335-4944-800c-278a0b4da6de tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:09:45.572973 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1cb8638c-f335-4944-800c-278a0b4da6de tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:45.573417 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1cb8638c-f335-4944-800c-278a0b4da6de tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:45.595475 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-1cb8638c-f335-4944-800c-278a0b4da6de tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Going to try to stop instance {{(pid=117124) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 04 19:09:45.637961 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-1cb8638c-f335-4944-800c-278a0b4da6de tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "POST /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d/action" status: 202 len: 0 microversion: 2.1 time: 0.075733 May 04 19:09:45.638559 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 259/509] 10.222.0.69 () {60 vars in 1277 bytes} [Wed May 4 19:09:45 2022] POST /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 04 19:09:45.647691 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-f768fab0-a7ae-4749-a16f-9a83d9a2c5e0 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:45.648391 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-f768fab0-a7ae-4749-a16f-9a83d9a2c5e0 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:45.655066 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f768fab0-a7ae-4749-a16f-9a83d9a2c5e0 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:45.655633 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f768fab0-a7ae-4749-a16f-9a83d9a2c5e0 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:45.656428 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f768fab0-a7ae-4749-a16f-9a83d9a2c5e0 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:45.656937 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f768fab0-a7ae-4749-a16f-9a83d9a2c5e0 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:45.782689 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-f768fab0-a7ae-4749-a16f-9a83d9a2c5e0 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:45.790516 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-f768fab0-a7ae-4749-a16f-9a83d9a2c5e0 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1675 microversion: 2.1 time: 0.146957 May 04 19:09:45.791182 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 251/510] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:09:45 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1675 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:09:46.809704 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-194272c7-0587-4cc8-81a8-a1d70c291437 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:46.810410 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-194272c7-0587-4cc8-81a8-a1d70c291437 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:46.816449 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-194272c7-0587-4cc8-81a8-a1d70c291437 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:46.816900 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-194272c7-0587-4cc8-81a8-a1d70c291437 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:46.818294 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-194272c7-0587-4cc8-81a8-a1d70c291437 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:46.818741 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-194272c7-0587-4cc8-81a8-a1d70c291437 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:46.944335 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-194272c7-0587-4cc8-81a8-a1d70c291437 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:46.951812 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-194272c7-0587-4cc8-81a8-a1d70c291437 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1675 microversion: 2.1 time: 0.146872 May 04 19:09:46.952378 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 260/511] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:09:46 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1675 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:09:47.461737 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-979b0c38-95a2-4e32-9ff9-81a8b0138229 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:47.462234 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-979b0c38-95a2-4e32-9ff9-81a8b0138229 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] [instance: 6b8b5bee-fd07-4dda-8996-a2d4099c151c] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:47.468565 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-979b0c38-95a2-4e32-9ff9-81a8b0138229 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:47.469010 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-979b0c38-95a2-4e32-9ff9-81a8b0138229 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:47.469827 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-979b0c38-95a2-4e32-9ff9-81a8b0138229 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:47.470258 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-979b0c38-95a2-4e32-9ff9-81a8b0138229 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:47.547156 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.objects.instance [None req-979b0c38-95a2-4e32-9ff9-81a8b0138229 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lazy-loading 'services' on Instance uuid 6b8b5bee-fd07-4dda-8996-a2d4099c151c {{(pid=117125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 04 19:09:47.616481 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-979b0c38-95a2-4e32-9ff9-81a8b0138229 tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] 10.222.0.69 "DELETE /compute/v2.1/servers/6b8b5bee-fd07-4dda-8996-a2d4099c151c/os-volume_attachments/e4b60fc4-ac7e-4d70-8f85-4f2e57a49bed" status: 202 len: 0 microversion: 2.1 time: 0.158932 May 04 19:09:47.617054 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 252/512] 10.222.0.69 () {58 vars in 1415 bytes} [Wed May 4 19:09:47 2022] DELETE /compute/v2.1/servers/6b8b5bee-fd07-4dda-8996-a2d4099c151c/os-volume_attachments/e4b60fc4-ac7e-4d70-8f85-4f2e57a49bed => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 04 19:09:47.969240 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-233bb90a-65e3-4365-b07e-9eda7ed2a4bb tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:47.969794 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-233bb90a-65e3-4365-b07e-9eda7ed2a4bb tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:47.976235 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-233bb90a-65e3-4365-b07e-9eda7ed2a4bb tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:47.976684 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-233bb90a-65e3-4365-b07e-9eda7ed2a4bb tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:47.977440 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-233bb90a-65e3-4365-b07e-9eda7ed2a4bb tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:47.977896 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-233bb90a-65e3-4365-b07e-9eda7ed2a4bb tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:48.103661 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-233bb90a-65e3-4365-b07e-9eda7ed2a4bb tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:48.110827 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-233bb90a-65e3-4365-b07e-9eda7ed2a4bb tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1675 microversion: 2.1 time: 0.145496 May 04 19:09:48.111388 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 261/513] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:09:47 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1675 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:09:48.730983 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-465d07d8-e0b8-4366-b52f-0fce1772f18a tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:48.731568 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-465d07d8-e0b8-4366-b52f-0fce1772f18a tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] [instance: 6b8b5bee-fd07-4dda-8996-a2d4099c151c] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:48.737692 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-465d07d8-e0b8-4366-b52f-0fce1772f18a tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:48.738135 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-465d07d8-e0b8-4366-b52f-0fce1772f18a tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:48.738889 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-465d07d8-e0b8-4366-b52f-0fce1772f18a tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:48.739319 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-465d07d8-e0b8-4366-b52f-0fce1772f18a tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:48.764319 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-465d07d8-e0b8-4366-b52f-0fce1772f18a tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] [instance: 6b8b5bee-fd07-4dda-8996-a2d4099c151c] Going to try to terminate instance {{(pid=117125) delete /opt/stack/nova/nova/compute/api.py:2664}} May 04 19:09:48.835006 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-465d07d8-e0b8-4366-b52f-0fce1772f18a tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] 10.222.0.69 "DELETE /compute/v2.1/servers/6b8b5bee-fd07-4dda-8996-a2d4099c151c" status: 204 len: 0 microversion: 2.1 time: 0.108786 May 04 19:09:48.835590 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 253/514] 10.222.0.69 () {58 vars in 1238 bytes} [Wed May 4 19:09:48 2022] DELETE /compute/v2.1/servers/6b8b5bee-fd07-4dda-8996-a2d4099c151c => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 04 19:09:48.843917 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-fd47666d-aae0-42e7-87fc-c85e26796e6c tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:48.844735 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-fd47666d-aae0-42e7-87fc-c85e26796e6c tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] [instance: 6b8b5bee-fd07-4dda-8996-a2d4099c151c] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:48.851614 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fd47666d-aae0-42e7-87fc-c85e26796e6c tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:48.852069 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fd47666d-aae0-42e7-87fc-c85e26796e6c tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:48.852852 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fd47666d-aae0-42e7-87fc-c85e26796e6c tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:48.853288 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fd47666d-aae0-42e7-87fc-c85e26796e6c tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:48.987559 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-fd47666d-aae0-42e7-87fc-c85e26796e6c tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632af5ddc209419a93461afdb070fc87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedb3ef21b1e413395b1a4cdcfb3f4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:48.997490 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-fd47666d-aae0-42e7-87fc-c85e26796e6c tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] 10.222.0.69 "GET /compute/v2.1/servers/6b8b5bee-fd07-4dda-8996-a2d4099c151c" status: 200 len: 1515 microversion: 2.1 time: 0.157475 May 04 19:09:48.998084 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 262/515] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:09:48 2022] GET /compute/v2.1/servers/6b8b5bee-fd07-4dda-8996-a2d4099c151c => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:09:49.128736 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-d4e6512e-2180-4d12-94a5-fc5400c3d0cf tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:49.129419 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-d4e6512e-2180-4d12-94a5-fc5400c3d0cf tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:49.135329 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d4e6512e-2180-4d12-94a5-fc5400c3d0cf tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:49.135771 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d4e6512e-2180-4d12-94a5-fc5400c3d0cf tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:49.136521 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d4e6512e-2180-4d12-94a5-fc5400c3d0cf tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:49.136948 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d4e6512e-2180-4d12-94a5-fc5400c3d0cf tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:49.265782 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-d4e6512e-2180-4d12-94a5-fc5400c3d0cf tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:49.273947 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-d4e6512e-2180-4d12-94a5-fc5400c3d0cf tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1675 microversion: 2.1 time: 0.149359 May 04 19:09:49.274538 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 254/516] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:09:49 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:09:50.015474 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-501e6c2c-83dd-4f2f-9c33-ea7018a45fcf tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:50.016091 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-501e6c2c-83dd-4f2f-9c33-ea7018a45fcf tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] [instance: 6b8b5bee-fd07-4dda-8996-a2d4099c151c] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:50.022680 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-501e6c2c-83dd-4f2f-9c33-ea7018a45fcf tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:50.023129 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-501e6c2c-83dd-4f2f-9c33-ea7018a45fcf tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:50.023899 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-501e6c2c-83dd-4f2f-9c33-ea7018a45fcf tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:50.024336 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-501e6c2c-83dd-4f2f-9c33-ea7018a45fcf tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:50.147987 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-501e6c2c-83dd-4f2f-9c33-ea7018a45fcf tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632af5ddc209419a93461afdb070fc87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedb3ef21b1e413395b1a4cdcfb3f4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:50.155206 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-501e6c2c-83dd-4f2f-9c33-ea7018a45fcf tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] 10.222.0.69 "GET /compute/v2.1/servers/6b8b5bee-fd07-4dda-8996-a2d4099c151c" status: 200 len: 1515 microversion: 2.1 time: 0.143637 May 04 19:09:50.155811 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 263/517] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:09:50 2022] GET /compute/v2.1/servers/6b8b5bee-fd07-4dda-8996-a2d4099c151c => generated 1515 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:09:50.290483 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-7efccc21-0c85-4fb0-9a59-dd78d8e7fe8f tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:50.291085 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-7efccc21-0c85-4fb0-9a59-dd78d8e7fe8f tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:50.297326 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7efccc21-0c85-4fb0-9a59-dd78d8e7fe8f tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:50.297816 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7efccc21-0c85-4fb0-9a59-dd78d8e7fe8f tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:50.298567 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7efccc21-0c85-4fb0-9a59-dd78d8e7fe8f tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:50.298995 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7efccc21-0c85-4fb0-9a59-dd78d8e7fe8f tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:50.423549 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-7efccc21-0c85-4fb0-9a59-dd78d8e7fe8f tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:50.430713 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-7efccc21-0c85-4fb0-9a59-dd78d8e7fe8f tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1675 microversion: 2.1 time: 0.144582 May 04 19:09:50.431267 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 255/518] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:09:50 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1675 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:09:51.172157 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-1df1b495-1048-46a0-a427-88b01e30e98d tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:51.172766 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-1df1b495-1048-46a0-a427-88b01e30e98d tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] [instance: 6b8b5bee-fd07-4dda-8996-a2d4099c151c] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:51.179635 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1df1b495-1048-46a0-a427-88b01e30e98d tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:51.180085 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1df1b495-1048-46a0-a427-88b01e30e98d tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:51.180848 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1df1b495-1048-46a0-a427-88b01e30e98d tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:51.181286 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1df1b495-1048-46a0-a427-88b01e30e98d tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:51.305987 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-1df1b495-1048-46a0-a427-88b01e30e98d tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632af5ddc209419a93461afdb070fc87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedb3ef21b1e413395b1a4cdcfb3f4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:51.313348 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-1df1b495-1048-46a0-a427-88b01e30e98d tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] 10.222.0.69 "GET /compute/v2.1/servers/6b8b5bee-fd07-4dda-8996-a2d4099c151c" status: 200 len: 1515 microversion: 2.1 time: 0.145061 May 04 19:09:51.314231 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 264/519] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:09:51 2022] GET /compute/v2.1/servers/6b8b5bee-fd07-4dda-8996-a2d4099c151c => generated 1515 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:09:51.447319 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-e293258e-03f1-4198-80c9-e81377e00fc5 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:51.447932 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-e293258e-03f1-4198-80c9-e81377e00fc5 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:51.454445 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e293258e-03f1-4198-80c9-e81377e00fc5 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:51.454891 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e293258e-03f1-4198-80c9-e81377e00fc5 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:51.455658 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e293258e-03f1-4198-80c9-e81377e00fc5 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:51.456095 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e293258e-03f1-4198-80c9-e81377e00fc5 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:51.580799 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-e293258e-03f1-4198-80c9-e81377e00fc5 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:51.588086 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-e293258e-03f1-4198-80c9-e81377e00fc5 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1675 microversion: 2.1 time: 0.144718 May 04 19:09:51.588652 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 256/520] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:09:51 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1675 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:09:51.832121 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-a7f131bc-e88b-45aa-b044-8dbe79da4fe9 req-3f8ce3dc-eb06-4833-887e-7abc2ddd2c40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b8b5bee-fd07-4dda-8996-a2d4099c151c", "name": "network-vif-deleted", "tag": "d2d16c3a-ab38-4e7c-98b2-a43d2b35343b"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:09:51.841474 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-a7f131bc-e88b-45aa-b044-8dbe79da4fe9 req-3f8ce3dc-eb06-4833-887e-7abc2ddd2c40 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:51.841932 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-a7f131bc-e88b-45aa-b044-8dbe79da4fe9 req-3f8ce3dc-eb06-4833-887e-7abc2ddd2c40 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:51.853632 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-a7f131bc-e88b-45aa-b044-8dbe79da4fe9 req-3f8ce3dc-eb06-4833-887e-7abc2ddd2c40 service nova] Creating event network-vif-deleted:d2d16c3a-ab38-4e7c-98b2-a43d2b35343b for instance 6b8b5bee-fd07-4dda-8996-a2d4099c151c on hv-cinder-83090 May 04 19:09:51.859260 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-a7f131bc-e88b-45aa-b044-8dbe79da4fe9 req-3f8ce3dc-eb06-4833-887e-7abc2ddd2c40 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031157 May 04 19:09:51.860071 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 265/521] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:09:52.331066 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-4c8f03ee-ca0d-479a-a94a-bcd82a1b24fe tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:52.331679 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-4c8f03ee-ca0d-479a-a94a-bcd82a1b24fe tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] [instance: 6b8b5bee-fd07-4dda-8996-a2d4099c151c] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:52.338111 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4c8f03ee-ca0d-479a-a94a-bcd82a1b24fe tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:52.338559 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4c8f03ee-ca0d-479a-a94a-bcd82a1b24fe tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:52.339322 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4c8f03ee-ca0d-479a-a94a-bcd82a1b24fe tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:52.339756 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4c8f03ee-ca0d-479a-a94a-bcd82a1b24fe tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:52.368985 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4c8f03ee-ca0d-479a-a94a-bcd82a1b24fe tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:52.369433 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4c8f03ee-ca0d-479a-a94a-bcd82a1b24fe tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:52.369906 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.objects.instance [None req-4c8f03ee-ca0d-479a-a94a-bcd82a1b24fe tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lazy-loading 'fault' on Instance uuid 6b8b5bee-fd07-4dda-8996-a2d4099c151c {{(pid=117125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 04 19:09:52.414008 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-4c8f03ee-ca0d-479a-a94a-bcd82a1b24fe tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632af5ddc209419a93461afdb070fc87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fedb3ef21b1e413395b1a4cdcfb3f4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:52.421224 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-4c8f03ee-ca0d-479a-a94a-bcd82a1b24fe tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] 10.222.0.69 "GET /compute/v2.1/servers/6b8b5bee-fd07-4dda-8996-a2d4099c151c" status: 200 len: 1309 microversion: 2.1 time: 0.094028 May 04 19:09:52.421816 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 257/522] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:09:52 2022] GET /compute/v2.1/servers/6b8b5bee-fd07-4dda-8996-a2d4099c151c => generated 1309 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:09:52.607285 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-9e10580d-6539-4f67-9768-4c1d286f2245 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:52.607908 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-9e10580d-6539-4f67-9768-4c1d286f2245 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:52.615409 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9e10580d-6539-4f67-9768-4c1d286f2245 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:52.615991 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9e10580d-6539-4f67-9768-4c1d286f2245 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:52.617075 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9e10580d-6539-4f67-9768-4c1d286f2245 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:52.617540 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9e10580d-6539-4f67-9768-4c1d286f2245 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:52.749875 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-9e10580d-6539-4f67-9768-4c1d286f2245 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:52.757210 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-9e10580d-6539-4f67-9768-4c1d286f2245 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1675 microversion: 2.1 time: 0.154603 May 04 19:09:52.757821 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 266/523] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:09:52 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:09:53.437757 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-8462734f-b1ec-48ae-902f-e52093a93f4b tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:53.438369 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-8462734f-b1ec-48ae-902f-e52093a93f4b tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] [instance: 6b8b5bee-fd07-4dda-8996-a2d4099c151c] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:53.445946 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8462734f-b1ec-48ae-902f-e52093a93f4b tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:53.446396 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8462734f-b1ec-48ae-902f-e52093a93f4b tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:53.447167 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8462734f-b1ec-48ae-902f-e52093a93f4b tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:53.447606 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8462734f-b1ec-48ae-902f-e52093a93f4b tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:53.460896 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.wsgi [None req-8462734f-b1ec-48ae-902f-e52093a93f4b tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] HTTP exception thrown: Instance 6b8b5bee-fd07-4dda-8996-a2d4099c151c could not be found. May 04 19:09:53.461500 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-8462734f-b1ec-48ae-902f-e52093a93f4b tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] Returning 404 to user: Instance 6b8b5bee-fd07-4dda-8996-a2d4099c151c could not be found. {{(pid=117125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 04 19:09:53.462312 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-8462734f-b1ec-48ae-902f-e52093a93f4b tempest-VolumesSnapshotTestJSON-167872944 tempest-VolumesSnapshotTestJSON-167872944-project] 10.222.0.69 "GET /compute/v2.1/servers/6b8b5bee-fd07-4dda-8996-a2d4099c151c" status: 404 len: 111 microversion: 2.1 time: 0.028548 May 04 19:09:53.462829 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 258/524] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:09:53 2022] GET /compute/v2.1/servers/6b8b5bee-fd07-4dda-8996-a2d4099c151c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 04 19:09:53.774090 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-9096fc30-7ca7-4a64-acc8-a2ae608b5357 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:53.774698 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-9096fc30-7ca7-4a64-acc8-a2ae608b5357 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:53.780919 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9096fc30-7ca7-4a64-acc8-a2ae608b5357 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:53.781361 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9096fc30-7ca7-4a64-acc8-a2ae608b5357 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:53.782173 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9096fc30-7ca7-4a64-acc8-a2ae608b5357 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:53.782607 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9096fc30-7ca7-4a64-acc8-a2ae608b5357 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:53.904779 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-9096fc30-7ca7-4a64-acc8-a2ae608b5357 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:53.912936 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-9096fc30-7ca7-4a64-acc8-a2ae608b5357 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1675 microversion: 2.1 time: 0.142485 May 04 19:09:53.913815 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 267/525] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:09:53 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1675 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:09:54.929937 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-3ca34145-7597-4c3e-be69-313c688fd895 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:54.930542 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-3ca34145-7597-4c3e-be69-313c688fd895 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:54.936761 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3ca34145-7597-4c3e-be69-313c688fd895 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:54.937205 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3ca34145-7597-4c3e-be69-313c688fd895 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:54.938007 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3ca34145-7597-4c3e-be69-313c688fd895 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:54.938438 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3ca34145-7597-4c3e-be69-313c688fd895 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:55.070749 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-3ca34145-7597-4c3e-be69-313c688fd895 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:55.081410 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-3ca34145-7597-4c3e-be69-313c688fd895 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1675 microversion: 2.1 time: 0.155717 May 04 19:09:55.082291 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 259/526] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:09:54 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:09:56.103478 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-7317a2cd-9263-46f9-9b7f-517d5a517a3f tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:56.104100 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-7317a2cd-9263-46f9-9b7f-517d5a517a3f tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:56.110442 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7317a2cd-9263-46f9-9b7f-517d5a517a3f tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:56.110894 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7317a2cd-9263-46f9-9b7f-517d5a517a3f tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:56.111656 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7317a2cd-9263-46f9-9b7f-517d5a517a3f tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:56.112094 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7317a2cd-9263-46f9-9b7f-517d5a517a3f tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:56.238980 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-7317a2cd-9263-46f9-9b7f-517d5a517a3f tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:56.246922 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-7317a2cd-9263-46f9-9b7f-517d5a517a3f tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1675 microversion: 2.1 time: 0.147288 May 04 19:09:56.247495 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 268/527] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:09:56 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1675 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:09:57.263958 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-5f232662-7c7f-4e3a-a9cf-8d660f47363a tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:57.264598 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-5f232662-7c7f-4e3a-a9cf-8d660f47363a tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:57.271702 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5f232662-7c7f-4e3a-a9cf-8d660f47363a tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:57.272148 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5f232662-7c7f-4e3a-a9cf-8d660f47363a tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:57.272906 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5f232662-7c7f-4e3a-a9cf-8d660f47363a tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:57.273339 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5f232662-7c7f-4e3a-a9cf-8d660f47363a tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:57.395289 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-5f232662-7c7f-4e3a-a9cf-8d660f47363a tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:57.403493 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-5f232662-7c7f-4e3a-a9cf-8d660f47363a tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1675 microversion: 2.1 time: 0.143420 May 04 19:09:57.404047 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 260/528] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:09:57 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1675 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:09:58.421140 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-3fbc1743-f752-4150-a6c2-4751c61f2448 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:58.421776 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-3fbc1743-f752-4150-a6c2-4751c61f2448 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:58.428505 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3fbc1743-f752-4150-a6c2-4751c61f2448 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:58.428954 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3fbc1743-f752-4150-a6c2-4751c61f2448 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:58.429751 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3fbc1743-f752-4150-a6c2-4751c61f2448 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:58.430189 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3fbc1743-f752-4150-a6c2-4751c61f2448 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:58.554979 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-3fbc1743-f752-4150-a6c2-4751c61f2448 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:58.562201 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-3fbc1743-f752-4150-a6c2-4751c61f2448 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1675 microversion: 2.1 time: 0.144914 May 04 19:09:58.562768 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 269/529] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:09:58 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1675 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:09:59.579074 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-e628793e-162a-4eda-9c85-0134095cf115 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:09:59.579600 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-e628793e-162a-4eda-9c85-0134095cf115 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:09:59.585890 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e628793e-162a-4eda-9c85-0134095cf115 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:59.586342 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e628793e-162a-4eda-9c85-0134095cf115 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:59.587103 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e628793e-162a-4eda-9c85-0134095cf115 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:09:59.587540 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e628793e-162a-4eda-9c85-0134095cf115 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:09:59.725823 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-e628793e-162a-4eda-9c85-0134095cf115 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:09:59.733363 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-e628793e-162a-4eda-9c85-0134095cf115 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1675 microversion: 2.1 time: 0.158117 May 04 19:09:59.734011 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 261/530] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:09:59 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:10:00.754064 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-fb838420-d78e-4200-b202-cf966dde1d56 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:00.754759 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-fb838420-d78e-4200-b202-cf966dde1d56 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:00.762447 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fb838420-d78e-4200-b202-cf966dde1d56 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:00.762929 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fb838420-d78e-4200-b202-cf966dde1d56 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:00.763694 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fb838420-d78e-4200-b202-cf966dde1d56 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:00.764131 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fb838420-d78e-4200-b202-cf966dde1d56 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:00.893560 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-fb838420-d78e-4200-b202-cf966dde1d56 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:00.900954 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-fb838420-d78e-4200-b202-cf966dde1d56 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1675 microversion: 2.1 time: 0.151146 May 04 19:10:00.901540 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 270/531] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:00 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:10:01.918375 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-b54c676e-456a-4af2-940a-f7ec68b9cffc tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:01.919007 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-b54c676e-456a-4af2-940a-f7ec68b9cffc tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:01.925375 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b54c676e-456a-4af2-940a-f7ec68b9cffc tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:01.925881 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b54c676e-456a-4af2-940a-f7ec68b9cffc tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:01.926666 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b54c676e-456a-4af2-940a-f7ec68b9cffc tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:01.927101 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b54c676e-456a-4af2-940a-f7ec68b9cffc tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:02.066258 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-b54c676e-456a-4af2-940a-f7ec68b9cffc tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:02.074115 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-b54c676e-456a-4af2-940a-f7ec68b9cffc tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1675 microversion: 2.1 time: 0.159598 May 04 19:10:02.074685 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 262/532] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:01 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:10:03.091867 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-0e603174-f0a6-4dec-bed4-c4861b706c45 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:03.092502 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-0e603174-f0a6-4dec-bed4-c4861b706c45 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:03.098737 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0e603174-f0a6-4dec-bed4-c4861b706c45 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:03.099850 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0e603174-f0a6-4dec-bed4-c4861b706c45 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:03.100605 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0e603174-f0a6-4dec-bed4-c4861b706c45 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:03.101043 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0e603174-f0a6-4dec-bed4-c4861b706c45 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:03.223893 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-0e603174-f0a6-4dec-bed4-c4861b706c45 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:03.231664 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-0e603174-f0a6-4dec-bed4-c4861b706c45 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1652 microversion: 2.1 time: 0.143678 May 04 19:10:03.232225 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 271/533] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:03 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1652 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:10:03.247640 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-ef5f41c1-2def-4db1-a3f2-d7553ae27453 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:10:03.253886 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ef5f41c1-2def-4db1-a3f2-d7553ae27453 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:03.254333 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ef5f41c1-2def-4db1-a3f2-d7553ae27453 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:03.311722 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-ef5f41c1-2def-4db1-a3f2-d7553ae27453 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Going to try to start instance {{(pid=117125) start /opt/stack/nova/nova/compute/api.py:2730}} May 04 19:10:03.351514 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-ef5f41c1-2def-4db1-a3f2-d7553ae27453 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "POST /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d/action" status: 202 len: 0 microversion: 2.1 time: 0.107520 May 04 19:10:03.352140 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 263/534] 10.222.0.69 () {60 vars in 1277 bytes} [Wed May 4 19:10:03 2022] POST /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 04 19:10:03.360161 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-5b4c1c05-5f9f-4098-92e4-02d3409778b8 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:03.360770 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-5b4c1c05-5f9f-4098-92e4-02d3409778b8 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:03.366592 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5b4c1c05-5f9f-4098-92e4-02d3409778b8 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:03.367059 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5b4c1c05-5f9f-4098-92e4-02d3409778b8 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:03.367796 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5b4c1c05-5f9f-4098-92e4-02d3409778b8 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:03.368229 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5b4c1c05-5f9f-4098-92e4-02d3409778b8 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:03.493234 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-5b4c1c05-5f9f-4098-92e4-02d3409778b8 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:03.500433 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-5b4c1c05-5f9f-4098-92e4-02d3409778b8 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1661 microversion: 2.1 time: 0.144193 May 04 19:10:03.501007 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 272/535] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:03 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1661 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:10:04.519437 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-b6ead3e4-d828-45f3-9c58-0f9789191545 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:04.520128 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-b6ead3e4-d828-45f3-9c58-0f9789191545 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:04.526771 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b6ead3e4-d828-45f3-9c58-0f9789191545 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:04.527217 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b6ead3e4-d828-45f3-9c58-0f9789191545 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:04.527983 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b6ead3e4-d828-45f3-9c58-0f9789191545 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:04.528420 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b6ead3e4-d828-45f3-9c58-0f9789191545 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:04.657133 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-b6ead3e4-d828-45f3-9c58-0f9789191545 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:04.665067 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-b6ead3e4-d828-45f3-9c58-0f9789191545 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1661 microversion: 2.1 time: 0.150635 May 04 19:10:04.665672 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 264/536] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:04 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1661 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:10:05.683686 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-99464252-d43a-44ea-807f-922d464c5ebe tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:05.684294 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-99464252-d43a-44ea-807f-922d464c5ebe tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:05.690673 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-99464252-d43a-44ea-807f-922d464c5ebe tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:05.691124 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-99464252-d43a-44ea-807f-922d464c5ebe tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:05.691882 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-99464252-d43a-44ea-807f-922d464c5ebe tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:05.692320 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-99464252-d43a-44ea-807f-922d464c5ebe tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:05.819324 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-99464252-d43a-44ea-807f-922d464c5ebe tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:05.826515 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-99464252-d43a-44ea-807f-922d464c5ebe tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1661 microversion: 2.1 time: 0.146638 May 04 19:10:05.827074 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 273/537] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:05 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1661 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:10:06.843302 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-eecec846-e6c3-437e-ba38-7bea74f06bd6 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:06.843868 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-eecec846-e6c3-437e-ba38-7bea74f06bd6 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:06.850121 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-eecec846-e6c3-437e-ba38-7bea74f06bd6 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:06.850570 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-eecec846-e6c3-437e-ba38-7bea74f06bd6 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:06.851325 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-eecec846-e6c3-437e-ba38-7bea74f06bd6 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:06.851763 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-eecec846-e6c3-437e-ba38-7bea74f06bd6 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:06.978181 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-eecec846-e6c3-437e-ba38-7bea74f06bd6 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:06.985530 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-eecec846-e6c3-437e-ba38-7bea74f06bd6 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1665 microversion: 2.1 time: 0.146144 May 04 19:10:06.986097 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 265/538] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:06 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1665 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:10:11.304560 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-f583b253-40f3-4eb6-a922-6469efccaf4f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "70f7367c-249b-4a7d-8b81-9cc0d2c5d772"}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:10:11.305643 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-f583b253-40f3-4eb6-a922-6469efccaf4f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:11.312163 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f583b253-40f3-4eb6-a922-6469efccaf4f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:11.312909 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f583b253-40f3-4eb6-a922-6469efccaf4f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:11.313353 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f583b253-40f3-4eb6-a922-6469efccaf4f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:11.313813 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f583b253-40f3-4eb6-a922-6469efccaf4f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:11.558453 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-f583b253-40f3-4eb6-a922-6469efccaf4f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "POST /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.258199 May 04 19:10:11.558989 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 274/539] 10.222.0.69 () {60 vars in 1322 bytes} [Wed May 4 19:10:11 2022] POST /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c/os-volume_attachments => generated 194 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:10:14.598052 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-758e2b2e-8458-4dd9-b443-4484bf274e91 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:14.598610 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-758e2b2e-8458-4dd9-b443-4484bf274e91 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:14.605307 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-758e2b2e-8458-4dd9-b443-4484bf274e91 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:14.605791 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-758e2b2e-8458-4dd9-b443-4484bf274e91 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:14.606608 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-758e2b2e-8458-4dd9-b443-4484bf274e91 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:14.607147 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-758e2b2e-8458-4dd9-b443-4484bf274e91 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:14.638988 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-758e2b2e-8458-4dd9-b443-4484bf274e91 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5/os-volume_attachments/3e15e307-0447-43a6-ad66-e1714ddcae37" status: 200 len: 194 microversion: 2.20 time: 0.045177 May 04 19:10:14.639566 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 266/540] 10.222.0.69 () {60 vars in 1453 bytes} [Wed May 4 19:10:14 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5/os-volume_attachments/3e15e307-0447-43a6-ad66-e1714ddcae37 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 04 19:10:14.702606 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-1c41c105-6e80-470f-847e-8e79bd9f1dd7 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:14.703190 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-1c41c105-6e80-470f-847e-8e79bd9f1dd7 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:14.709977 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1c41c105-6e80-470f-847e-8e79bd9f1dd7 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:14.710481 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1c41c105-6e80-470f-847e-8e79bd9f1dd7 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:14.711249 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1c41c105-6e80-470f-847e-8e79bd9f1dd7 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:14.711924 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1c41c105-6e80-470f-847e-8e79bd9f1dd7 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:14.837289 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.objects.instance [None req-1c41c105-6e80-470f-847e-8e79bd9f1dd7 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lazy-loading 'services' on Instance uuid 8f929e9e-51bf-477a-877b-6c162202c7f5 {{(pid=117124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 04 19:10:14.944165 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-1c41c105-6e80-470f-847e-8e79bd9f1dd7 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "DELETE /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5/os-volume_attachments/3e15e307-0447-43a6-ad66-e1714ddcae37" status: 202 len: 0 microversion: 2.20 time: 0.245657 May 04 19:10:14.944746 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 275/541] 10.222.0.69 () {60 vars in 1456 bytes} [Wed May 4 19:10:14 2022] DELETE /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5/os-volume_attachments/3e15e307-0447-43a6-ad66-e1714ddcae37 => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 04 19:10:14.953131 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-71868f6c-a1ba-4c87-9683-f9e5c751992f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:14.954341 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-71868f6c-a1ba-4c87-9683-f9e5c751992f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:14.961018 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-71868f6c-a1ba-4c87-9683-f9e5c751992f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:14.961481 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-71868f6c-a1ba-4c87-9683-f9e5c751992f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:14.962434 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-71868f6c-a1ba-4c87-9683-f9e5c751992f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:14.963018 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-71868f6c-a1ba-4c87-9683-f9e5c751992f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:14.993602 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-71868f6c-a1ba-4c87-9683-f9e5c751992f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044256 May 04 19:10:14.994165 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 267/542] 10.222.0.69 () {60 vars in 1342 bytes} [Wed May 4 19:10:14 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 04 19:10:16.005398 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-2cda8d3b-a9df-4929-8b44-34c7c6cabb2e tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:16.006614 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-2cda8d3b-a9df-4929-8b44-34c7c6cabb2e tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:16.012682 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2cda8d3b-a9df-4929-8b44-34c7c6cabb2e tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:16.013266 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2cda8d3b-a9df-4929-8b44-34c7c6cabb2e tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:16.014158 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2cda8d3b-a9df-4929-8b44-34c7c6cabb2e tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:16.014612 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2cda8d3b-a9df-4929-8b44-34c7c6cabb2e tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:16.045886 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-2cda8d3b-a9df-4929-8b44-34c7c6cabb2e tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045231 May 04 19:10:16.049833 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 276/543] 10.222.0.69 () {60 vars in 1342 bytes} [Wed May 4 19:10:15 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 04 19:10:17.058006 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-c7d8eae3-1428-4740-948c-04f9ad8144ff tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:17.058960 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-c7d8eae3-1428-4740-948c-04f9ad8144ff tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:17.065592 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c7d8eae3-1428-4740-948c-04f9ad8144ff tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:17.066086 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c7d8eae3-1428-4740-948c-04f9ad8144ff tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:17.067006 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c7d8eae3-1428-4740-948c-04f9ad8144ff tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:17.067439 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c7d8eae3-1428-4740-948c-04f9ad8144ff tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:17.096024 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-c7d8eae3-1428-4740-948c-04f9ad8144ff tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042470 May 04 19:10:17.096584 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 268/544] 10.222.0.69 () {60 vars in 1342 bytes} [Wed May 4 19:10:17 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 04 19:10:18.005633 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-5a677db1-1a02-4d86-b490-acabf2b5e726 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:18.006130 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-5a677db1-1a02-4d86-b490-acabf2b5e726 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 50e3af6c-83e8-4320-8157-06ed4ef20cda] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:18.012869 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5a677db1-1a02-4d86-b490-acabf2b5e726 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:18.013317 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5a677db1-1a02-4d86-b490-acabf2b5e726 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:18.014110 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5a677db1-1a02-4d86-b490-acabf2b5e726 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:18.014545 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5a677db1-1a02-4d86-b490-acabf2b5e726 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:18.036662 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-5a677db1-1a02-4d86-b490-acabf2b5e726 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/50e3af6c-83e8-4320-8157-06ed4ef20cda/ips" status: 200 len: 150 microversion: 2.1 time: 0.034929 May 04 19:10:18.037219 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 277/545] 10.222.0.69 () {58 vars in 1247 bytes} [Wed May 4 19:10:18 2022] GET /compute/v2.1/servers/50e3af6c-83e8-4320-8157-06ed4ef20cda/ips => generated 150 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:10:18.047366 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-532afe87-6021-47d0-bece-0f4f572bbbf9 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "95402f99-7bfa-4e95-9f62-d89ba73424fc"}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:10:18.048424 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-532afe87-6021-47d0-bece-0f4f572bbbf9 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 50e3af6c-83e8-4320-8157-06ed4ef20cda] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:18.054184 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-532afe87-6021-47d0-bece-0f4f572bbbf9 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:18.055153 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-532afe87-6021-47d0-bece-0f4f572bbbf9 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:18.055911 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-532afe87-6021-47d0-bece-0f4f572bbbf9 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:18.056345 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-532afe87-6021-47d0-bece-0f4f572bbbf9 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:18.108454 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-b85a6ecc-419b-463d-adde-a3a36a9a7f5e tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:18.109398 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-b85a6ecc-419b-463d-adde-a3a36a9a7f5e tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:18.115339 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b85a6ecc-419b-463d-adde-a3a36a9a7f5e tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:18.115790 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b85a6ecc-419b-463d-adde-a3a36a9a7f5e tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:18.116551 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b85a6ecc-419b-463d-adde-a3a36a9a7f5e tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:18.117558 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b85a6ecc-419b-463d-adde-a3a36a9a7f5e tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:18.134739 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.wsgi [None req-532afe87-6021-47d0-bece-0f4f572bbbf9 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] HTTP exception thrown: Invalid volume: volume 95402f99-7bfa-4e95-9f62-d89ba73424fc is already attached to instances: fae4a97e-a910-4f71-abf2-8f62425c6a52 May 04 19:10:18.135339 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-532afe87-6021-47d0-bece-0f4f572bbbf9 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Returning 400 to user: Invalid volume: volume 95402f99-7bfa-4e95-9f62-d89ba73424fc is already attached to instances: fae4a97e-a910-4f71-abf2-8f62425c6a52 {{(pid=117125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 04 19:10:18.136162 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-532afe87-6021-47d0-bece-0f4f572bbbf9 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "POST /compute/v2.1/servers/50e3af6c-83e8-4320-8157-06ed4ef20cda/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.092770 May 04 19:10:18.136710 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 269/546] 10.222.0.69 () {60 vars in 1322 bytes} [Wed May 4 19:10:18 2022] POST /compute/v2.1/servers/50e3af6c-83e8-4320-8157-06ed4ef20cda/os-volume_attachments => generated 174 bytes in 94 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 04 19:10:18.144882 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-a52b22e1-4608-4553-9203-dbed7b79c80a tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:18.145371 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-a52b22e1-4608-4553-9203-dbed7b79c80a tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 50e3af6c-83e8-4320-8157-06ed4ef20cda] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:18.152100 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a52b22e1-4608-4553-9203-dbed7b79c80a tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:18.152572 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a52b22e1-4608-4553-9203-dbed7b79c80a tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:18.153320 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a52b22e1-4608-4553-9203-dbed7b79c80a tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:18.153776 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a52b22e1-4608-4553-9203-dbed7b79c80a tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:18.154708 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-b85a6ecc-419b-463d-adde-a3a36a9a7f5e tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050246 May 04 19:10:18.155265 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 278/547] 10.222.0.69 () {60 vars in 1342 bytes} [Wed May 4 19:10:18 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 04 19:10:18.176954 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-a52b22e1-4608-4553-9203-dbed7b79c80a tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 50e3af6c-83e8-4320-8157-06ed4ef20cda] Going to try to terminate instance {{(pid=117125) delete /opt/stack/nova/nova/compute/api.py:2664}} May 04 19:10:18.250019 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-a52b22e1-4608-4553-9203-dbed7b79c80a tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "DELETE /compute/v2.1/servers/50e3af6c-83e8-4320-8157-06ed4ef20cda" status: 204 len: 0 microversion: 2.1 time: 0.108775 May 04 19:10:18.250597 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 270/548] 10.222.0.69 () {58 vars in 1238 bytes} [Wed May 4 19:10:18 2022] DELETE /compute/v2.1/servers/50e3af6c-83e8-4320-8157-06ed4ef20cda => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 04 19:10:18.259562 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-b812d2b5-62f2-4ce5-a707-cb99d271088f tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:18.260170 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-b812d2b5-62f2-4ce5-a707-cb99d271088f tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 50e3af6c-83e8-4320-8157-06ed4ef20cda] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:18.265898 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b812d2b5-62f2-4ce5-a707-cb99d271088f tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:18.266530 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b812d2b5-62f2-4ce5-a707-cb99d271088f tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:18.267546 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b812d2b5-62f2-4ce5-a707-cb99d271088f tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:18.267977 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b812d2b5-62f2-4ce5-a707-cb99d271088f tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:18.407600 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-b812d2b5-62f2-4ce5-a707-cb99d271088f tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:18.416071 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-b812d2b5-62f2-4ce5-a707-cb99d271088f tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/50e3af6c-83e8-4320-8157-06ed4ef20cda" status: 200 len: 1683 microversion: 2.1 time: 0.161127 May 04 19:10:18.416986 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 279/549] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:18 2022] GET /compute/v2.1/servers/50e3af6c-83e8-4320-8157-06ed4ef20cda => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:10:19.167184 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-292fbbbf-d79a-4389-b9ef-6753fe5b6b2f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:19.168224 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-292fbbbf-d79a-4389-b9ef-6753fe5b6b2f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:19.174740 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-292fbbbf-d79a-4389-b9ef-6753fe5b6b2f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:19.175193 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-292fbbbf-d79a-4389-b9ef-6753fe5b6b2f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:19.175953 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-292fbbbf-d79a-4389-b9ef-6753fe5b6b2f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:19.176393 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-292fbbbf-d79a-4389-b9ef-6753fe5b6b2f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:19.205049 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-292fbbbf-d79a-4389-b9ef-6753fe5b6b2f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042252 May 04 19:10:19.205564 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 271/550] 10.222.0.69 () {60 vars in 1342 bytes} [Wed May 4 19:10:19 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 04 19:10:19.433690 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-0257dcb5-d469-4885-8668-5037eeae0ff9 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:19.434302 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-0257dcb5-d469-4885-8668-5037eeae0ff9 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 50e3af6c-83e8-4320-8157-06ed4ef20cda] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:19.440792 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0257dcb5-d469-4885-8668-5037eeae0ff9 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:19.441240 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0257dcb5-d469-4885-8668-5037eeae0ff9 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:19.442140 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0257dcb5-d469-4885-8668-5037eeae0ff9 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:19.442572 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0257dcb5-d469-4885-8668-5037eeae0ff9 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:19.571392 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-0257dcb5-d469-4885-8668-5037eeae0ff9 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:19.578627 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-0257dcb5-d469-4885-8668-5037eeae0ff9 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/50e3af6c-83e8-4320-8157-06ed4ef20cda" status: 200 len: 1683 microversion: 2.1 time: 0.148900 May 04 19:10:19.579195 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 280/551] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:19 2022] GET /compute/v2.1/servers/50e3af6c-83e8-4320-8157-06ed4ef20cda => generated 1683 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:10:20.217077 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-f83c71d2-c4ed-425a-a572-1e466fb32db4 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:20.218057 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-f83c71d2-c4ed-425a-a572-1e466fb32db4 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:20.224377 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f83c71d2-c4ed-425a-a572-1e466fb32db4 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:20.224824 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f83c71d2-c4ed-425a-a572-1e466fb32db4 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:20.225595 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f83c71d2-c4ed-425a-a572-1e466fb32db4 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:20.226035 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f83c71d2-c4ed-425a-a572-1e466fb32db4 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:20.253885 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-f83c71d2-c4ed-425a-a572-1e466fb32db4 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040808 May 04 19:10:20.254427 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 272/552] 10.222.0.69 () {60 vars in 1342 bytes} [Wed May 4 19:10:20 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 04 19:10:20.595947 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-1915b7e2-35b9-498f-befa-72cc09e22ee8 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:20.596576 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-1915b7e2-35b9-498f-befa-72cc09e22ee8 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 50e3af6c-83e8-4320-8157-06ed4ef20cda] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:20.602912 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1915b7e2-35b9-498f-befa-72cc09e22ee8 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:20.603358 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1915b7e2-35b9-498f-befa-72cc09e22ee8 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:20.604102 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1915b7e2-35b9-498f-befa-72cc09e22ee8 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:20.604530 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1915b7e2-35b9-498f-befa-72cc09e22ee8 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:20.729439 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-1915b7e2-35b9-498f-befa-72cc09e22ee8 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:20.736607 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-1915b7e2-35b9-498f-befa-72cc09e22ee8 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/50e3af6c-83e8-4320-8157-06ed4ef20cda" status: 200 len: 1683 microversion: 2.1 time: 0.144506 May 04 19:10:20.737163 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 281/553] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:20 2022] GET /compute/v2.1/servers/50e3af6c-83e8-4320-8157-06ed4ef20cda => generated 1683 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:10:21.265428 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-a4b1a426-4247-4fdd-9068-ccad088cdc06 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:21.266311 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-a4b1a426-4247-4fdd-9068-ccad088cdc06 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:21.272788 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a4b1a426-4247-4fdd-9068-ccad088cdc06 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:21.273229 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a4b1a426-4247-4fdd-9068-ccad088cdc06 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:21.274011 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a4b1a426-4247-4fdd-9068-ccad088cdc06 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:21.274454 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a4b1a426-4247-4fdd-9068-ccad088cdc06 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:21.306997 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-a4b1a426-4247-4fdd-9068-ccad088cdc06 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045463 May 04 19:10:21.311156 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 273/554] 10.222.0.69 () {60 vars in 1342 bytes} [Wed May 4 19:10:21 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 04 19:10:21.752659 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-617e4d76-fdb4-487c-83bc-9e5f471d715d tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:21.753297 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-617e4d76-fdb4-487c-83bc-9e5f471d715d tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 50e3af6c-83e8-4320-8157-06ed4ef20cda] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:21.759723 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-617e4d76-fdb4-487c-83bc-9e5f471d715d tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:21.760172 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-617e4d76-fdb4-487c-83bc-9e5f471d715d tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:21.760937 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-617e4d76-fdb4-487c-83bc-9e5f471d715d tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:21.761376 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-617e4d76-fdb4-487c-83bc-9e5f471d715d tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:21.894828 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-617e4d76-fdb4-487c-83bc-9e5f471d715d tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:21.903098 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-617e4d76-fdb4-487c-83bc-9e5f471d715d tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/50e3af6c-83e8-4320-8157-06ed4ef20cda" status: 200 len: 1683 microversion: 2.1 time: 0.154267 May 04 19:10:21.903823 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 282/555] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:21 2022] GET /compute/v2.1/servers/50e3af6c-83e8-4320-8157-06ed4ef20cda => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:10:22.184602 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-b2324e1c-6b0e-467f-9548-cff1a7f3312d tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:10:22.185560 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-b2324e1c-6b0e-467f-9548-cff1a7f3312d tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:22.191271 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b2324e1c-6b0e-467f-9548-cff1a7f3312d tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:22.191716 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b2324e1c-6b0e-467f-9548-cff1a7f3312d tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:22.192467 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b2324e1c-6b0e-467f-9548-cff1a7f3312d tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:22.192899 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b2324e1c-6b0e-467f-9548-cff1a7f3312d tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:22.215433 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.objects.instance [None req-b2324e1c-6b0e-467f-9548-cff1a7f3312d tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lazy-loading 'flavor' on Instance uuid 17de0a81-ab42-475e-b6f3-dd853adc826c {{(pid=117125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 04 19:10:22.318928 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-108a07f1-4560-4e3f-9975-b01e80c05473 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:22.320607 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-108a07f1-4560-4e3f-9975-b01e80c05473 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:22.326717 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-108a07f1-4560-4e3f-9975-b01e80c05473 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:22.327168 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-108a07f1-4560-4e3f-9975-b01e80c05473 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:22.328076 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-108a07f1-4560-4e3f-9975-b01e80c05473 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:22.328553 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-108a07f1-4560-4e3f-9975-b01e80c05473 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:22.337037 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-b2324e1c-6b0e-467f-9548-cff1a7f3312d tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "POST /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c/action" status: 200 len: 32 microversion: 2.1 time: 0.156231 May 04 19:10:22.341650 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 274/556] 10.222.0.69 () {60 vars in 1277 bytes} [Wed May 4 19:10:22 2022] POST /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c/action => generated 32 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 04 19:10:22.347033 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-c1e587b7-0b64-4f0b-b488-29e5974a5187 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:22.347757 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-c1e587b7-0b64-4f0b-b488-29e5974a5187 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:22.353898 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c1e587b7-0b64-4f0b-b488-29e5974a5187 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:22.354357 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c1e587b7-0b64-4f0b-b488-29e5974a5187 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:22.355137 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c1e587b7-0b64-4f0b-b488-29e5974a5187 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:22.355575 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c1e587b7-0b64-4f0b-b488-29e5974a5187 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:22.358971 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-108a07f1-4560-4e3f-9975-b01e80c05473 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044292 May 04 19:10:22.359546 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 283/557] 10.222.0.69 () {60 vars in 1342 bytes} [Wed May 4 19:10:22 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 04 19:10:22.484723 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-c1e587b7-0b64-4f0b-b488-29e5974a5187 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:22.493716 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-c1e587b7-0b64-4f0b-b488-29e5974a5187 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 200 len: 1735 microversion: 2.1 time: 0.150697 May 04 19:10:22.494432 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 275/558] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:22 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:10:22.920590 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-6c85b921-bf47-4a77-bb10-24edea8f5bc4 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:22.921203 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-6c85b921-bf47-4a77-bb10-24edea8f5bc4 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 50e3af6c-83e8-4320-8157-06ed4ef20cda] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:22.927568 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6c85b921-bf47-4a77-bb10-24edea8f5bc4 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:22.927966 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6c85b921-bf47-4a77-bb10-24edea8f5bc4 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:22.928730 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6c85b921-bf47-4a77-bb10-24edea8f5bc4 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:22.929787 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6c85b921-bf47-4a77-bb10-24edea8f5bc4 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:23.056469 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-6c85b921-bf47-4a77-bb10-24edea8f5bc4 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:23.063680 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-6c85b921-bf47-4a77-bb10-24edea8f5bc4 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/50e3af6c-83e8-4320-8157-06ed4ef20cda" status: 200 len: 1683 microversion: 2.1 time: 0.146971 May 04 19:10:23.064281 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 284/559] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:22 2022] GET /compute/v2.1/servers/50e3af6c-83e8-4320-8157-06ed4ef20cda => generated 1683 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:10:23.371978 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-0bb84313-1907-48a8-b579-5bde75ce362b tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:23.372893 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-0bb84313-1907-48a8-b579-5bde75ce362b tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:23.379210 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0bb84313-1907-48a8-b579-5bde75ce362b tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:23.379651 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0bb84313-1907-48a8-b579-5bde75ce362b tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:23.380401 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0bb84313-1907-48a8-b579-5bde75ce362b tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:23.380829 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0bb84313-1907-48a8-b579-5bde75ce362b tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:23.409910 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-0bb84313-1907-48a8-b579-5bde75ce362b tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043648 May 04 19:10:23.410458 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 276/560] 10.222.0.69 () {60 vars in 1342 bytes} [Wed May 4 19:10:23 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 04 19:10:23.510997 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-478016b9-6322-494d-9e03-bbe32483382f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:23.511631 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-478016b9-6322-494d-9e03-bbe32483382f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:23.517897 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-478016b9-6322-494d-9e03-bbe32483382f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:23.518349 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-478016b9-6322-494d-9e03-bbe32483382f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:23.519110 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-478016b9-6322-494d-9e03-bbe32483382f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:23.519549 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-478016b9-6322-494d-9e03-bbe32483382f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:23.643286 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-478016b9-6322-494d-9e03-bbe32483382f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:23.651560 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-478016b9-6322-494d-9e03-bbe32483382f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 200 len: 1735 microversion: 2.1 time: 0.144361 May 04 19:10:23.652124 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 285/561] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:23 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 1735 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:10:24.084196 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-d663308d-c492-40c8-92c1-826ed48460a5 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:24.084802 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-d663308d-c492-40c8-92c1-826ed48460a5 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 50e3af6c-83e8-4320-8157-06ed4ef20cda] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:24.090745 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d663308d-c492-40c8-92c1-826ed48460a5 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:24.091191 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d663308d-c492-40c8-92c1-826ed48460a5 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:24.091939 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d663308d-c492-40c8-92c1-826ed48460a5 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:24.092368 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d663308d-c492-40c8-92c1-826ed48460a5 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:24.217891 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-d663308d-c492-40c8-92c1-826ed48460a5 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:24.225134 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-d663308d-c492-40c8-92c1-826ed48460a5 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/50e3af6c-83e8-4320-8157-06ed4ef20cda" status: 200 len: 1683 microversion: 2.1 time: 0.144742 May 04 19:10:24.225726 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 277/562] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:24 2022] GET /compute/v2.1/servers/50e3af6c-83e8-4320-8157-06ed4ef20cda => generated 1683 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:10:24.422278 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-a6202540-ef1e-4a25-aea2-4360b1e917a9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:24.423206 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-a6202540-ef1e-4a25-aea2-4360b1e917a9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:24.430146 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a6202540-ef1e-4a25-aea2-4360b1e917a9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:24.430599 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a6202540-ef1e-4a25-aea2-4360b1e917a9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:24.431358 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a6202540-ef1e-4a25-aea2-4360b1e917a9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:24.431796 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a6202540-ef1e-4a25-aea2-4360b1e917a9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:24.459887 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-a6202540-ef1e-4a25-aea2-4360b1e917a9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041553 May 04 19:10:24.460432 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 286/563] 10.222.0.69 () {60 vars in 1342 bytes} [Wed May 4 19:10:24 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 04 19:10:24.668607 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-e889d82d-982e-4b5b-85a3-15bceaf96396 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:24.669909 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-e889d82d-982e-4b5b-85a3-15bceaf96396 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:24.676731 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e889d82d-982e-4b5b-85a3-15bceaf96396 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:24.677182 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e889d82d-982e-4b5b-85a3-15bceaf96396 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:24.677975 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e889d82d-982e-4b5b-85a3-15bceaf96396 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:24.678716 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e889d82d-982e-4b5b-85a3-15bceaf96396 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:25.201429 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-e889d82d-982e-4b5b-85a3-15bceaf96396 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:25.209298 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-e889d82d-982e-4b5b-85a3-15bceaf96396 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 200 len: 1735 microversion: 2.1 time: 0.544503 May 04 19:10:25.209906 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 278/564] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:24 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 1735 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:10:25.242166 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-1cc90062-1d14-44f7-b76e-9492db31a758 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:25.242784 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-1cc90062-1d14-44f7-b76e-9492db31a758 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 50e3af6c-83e8-4320-8157-06ed4ef20cda] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:25.248647 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1cc90062-1d14-44f7-b76e-9492db31a758 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:25.249281 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1cc90062-1d14-44f7-b76e-9492db31a758 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:25.250078 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1cc90062-1d14-44f7-b76e-9492db31a758 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:25.250521 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1cc90062-1d14-44f7-b76e-9492db31a758 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:25.387506 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-1cc90062-1d14-44f7-b76e-9492db31a758 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:25.394959 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-1cc90062-1d14-44f7-b76e-9492db31a758 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/50e3af6c-83e8-4320-8157-06ed4ef20cda" status: 200 len: 1683 microversion: 2.1 time: 0.156656 May 04 19:10:25.395531 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 287/565] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:25 2022] GET /compute/v2.1/servers/50e3af6c-83e8-4320-8157-06ed4ef20cda => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:10:25.471498 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-7424e132-2d68-44e1-85d9-63a68e5b3242 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:25.472544 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-7424e132-2d68-44e1-85d9-63a68e5b3242 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:25.478456 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7424e132-2d68-44e1-85d9-63a68e5b3242 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:25.478987 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7424e132-2d68-44e1-85d9-63a68e5b3242 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:25.479804 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7424e132-2d68-44e1-85d9-63a68e5b3242 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:25.480303 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7424e132-2d68-44e1-85d9-63a68e5b3242 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:25.508892 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-7424e132-2d68-44e1-85d9-63a68e5b3242 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041402 May 04 19:10:25.509657 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 279/566] 10.222.0.69 () {60 vars in 1342 bytes} [Wed May 4 19:10:25 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:10:25.566276 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-b51f2643-a89c-464b-81e5-5457313f9c12 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:25.566801 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-b51f2643-a89c-464b-81e5-5457313f9c12 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:25.573755 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b51f2643-a89c-464b-81e5-5457313f9c12 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:25.574202 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b51f2643-a89c-464b-81e5-5457313f9c12 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:25.574960 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b51f2643-a89c-464b-81e5-5457313f9c12 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:25.575395 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b51f2643-a89c-464b-81e5-5457313f9c12 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:25.600648 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-b51f2643-a89c-464b-81e5-5457313f9c12 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Going to try to terminate instance {{(pid=117124) delete /opt/stack/nova/nova/compute/api.py:2664}} May 04 19:10:25.676025 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-b51f2643-a89c-464b-81e5-5457313f9c12 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "DELETE /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 204 len: 0 microversion: 2.20 time: 0.113370 May 04 19:10:25.676609 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 288/567] 10.222.0.69 () {60 vars in 1279 bytes} [Wed May 4 19:10:25 2022] DELETE /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 04 19:10:25.686290 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-45aaa92c-ac97-4b39-8ea0-d3484d53a812 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:25.687094 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-45aaa92c-ac97-4b39-8ea0-d3484d53a812 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:25.693633 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-45aaa92c-ac97-4b39-8ea0-d3484d53a812 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:25.694160 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-45aaa92c-ac97-4b39-8ea0-d3484d53a812 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:25.695628 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-45aaa92c-ac97-4b39-8ea0-d3484d53a812 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:25.696293 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-45aaa92c-ac97-4b39-8ea0-d3484d53a812 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:25.883683 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-45aaa92c-ac97-4b39-8ea0-d3484d53a812 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:25.891547 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-45aaa92c-ac97-4b39-8ea0-d3484d53a812 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:25.893293 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-45aaa92c-ac97-4b39-8ea0-d3484d53a812 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:25.894466 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-45aaa92c-ac97-4b39-8ea0-d3484d53a812 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1724 microversion: 2.20 time: 0.212492 May 04 19:10:25.895239 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 280/568] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:10:25 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1724 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:10:25.991185 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-16fca3f4-55b3-43c8-9289-dadc78eb985c req-315380ac-e135-4c05-a29c-0f8cb91cce07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50e3af6c-83e8-4320-8157-06ed4ef20cda", "name": "network-vif-deleted", "tag": "f03e3054-1bc8-4f86-b799-59096192f4ee"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:10:26.000531 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-16fca3f4-55b3-43c8-9289-dadc78eb985c req-315380ac-e135-4c05-a29c-0f8cb91cce07 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:26.001101 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-16fca3f4-55b3-43c8-9289-dadc78eb985c req-315380ac-e135-4c05-a29c-0f8cb91cce07 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:26.014622 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-16fca3f4-55b3-43c8-9289-dadc78eb985c req-315380ac-e135-4c05-a29c-0f8cb91cce07 service nova] Creating event network-vif-deleted:f03e3054-1bc8-4f86-b799-59096192f4ee for instance 50e3af6c-83e8-4320-8157-06ed4ef20cda on hv-cinder-83090 May 04 19:10:26.020512 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-16fca3f4-55b3-43c8-9289-dadc78eb985c req-315380ac-e135-4c05-a29c-0f8cb91cce07 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033067 May 04 19:10:26.021154 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 289/569] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:10:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 04 19:10:26.227819 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-bb830f25-e088-463e-94a0-d90f6124fe17 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:26.228424 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-bb830f25-e088-463e-94a0-d90f6124fe17 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:26.234591 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-bb830f25-e088-463e-94a0-d90f6124fe17 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:26.235032 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-bb830f25-e088-463e-94a0-d90f6124fe17 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:26.235794 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-bb830f25-e088-463e-94a0-d90f6124fe17 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:26.236405 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-bb830f25-e088-463e-94a0-d90f6124fe17 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:26.388033 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-bb830f25-e088-463e-94a0-d90f6124fe17 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:26.396290 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-bb830f25-e088-463e-94a0-d90f6124fe17 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 200 len: 1735 microversion: 2.1 time: 0.172915 May 04 19:10:26.397144 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 281/570] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:26 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:10:26.419081 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-9e8adf05-15a4-41ee-bc1a-179aa7be3ed5 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:26.419784 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-9e8adf05-15a4-41ee-bc1a-179aa7be3ed5 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 50e3af6c-83e8-4320-8157-06ed4ef20cda] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:26.426005 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9e8adf05-15a4-41ee-bc1a-179aa7be3ed5 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:26.426454 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9e8adf05-15a4-41ee-bc1a-179aa7be3ed5 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:26.427218 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9e8adf05-15a4-41ee-bc1a-179aa7be3ed5 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:26.427649 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9e8adf05-15a4-41ee-bc1a-179aa7be3ed5 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:26.492296 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-9e8adf05-15a4-41ee-bc1a-179aa7be3ed5 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:26.499883 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-9e8adf05-15a4-41ee-bc1a-179aa7be3ed5 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/50e3af6c-83e8-4320-8157-06ed4ef20cda" status: 200 len: 1615 microversion: 2.1 time: 0.087375 May 04 19:10:26.500795 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 290/571] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:26 2022] GET /compute/v2.1/servers/50e3af6c-83e8-4320-8157-06ed4ef20cda => generated 1615 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:10:26.912213 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-611d20b4-68e5-46ba-90b6-4b5182be6115 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:26.912822 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-611d20b4-68e5-46ba-90b6-4b5182be6115 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:26.922776 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-611d20b4-68e5-46ba-90b6-4b5182be6115 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:26.923227 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-611d20b4-68e5-46ba-90b6-4b5182be6115 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:26.924055 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-611d20b4-68e5-46ba-90b6-4b5182be6115 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:26.924492 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-611d20b4-68e5-46ba-90b6-4b5182be6115 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:27.062367 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-611d20b4-68e5-46ba-90b6-4b5182be6115 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:27.071428 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-611d20b4-68e5-46ba-90b6-4b5182be6115 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:27.072992 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-611d20b4-68e5-46ba-90b6-4b5182be6115 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:27.074383 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-611d20b4-68e5-46ba-90b6-4b5182be6115 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1724 microversion: 2.20 time: 0.166066 May 04 19:10:27.075513 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 282/572] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:10:26 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:10:27.413900 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-d24ad31a-34b4-4e13-a797-413e84342e41 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:27.414527 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-d24ad31a-34b4-4e13-a797-413e84342e41 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:27.420840 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d24ad31a-34b4-4e13-a797-413e84342e41 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:27.421289 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d24ad31a-34b4-4e13-a797-413e84342e41 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:27.422089 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d24ad31a-34b4-4e13-a797-413e84342e41 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:27.422525 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d24ad31a-34b4-4e13-a797-413e84342e41 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:27.515878 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-56436c9a-908c-42de-9406-a86d10d97b8a tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:27.516891 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-56436c9a-908c-42de-9406-a86d10d97b8a tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 50e3af6c-83e8-4320-8157-06ed4ef20cda] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:27.522858 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-56436c9a-908c-42de-9406-a86d10d97b8a tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:27.523424 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-56436c9a-908c-42de-9406-a86d10d97b8a tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:27.524350 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-56436c9a-908c-42de-9406-a86d10d97b8a tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:27.524849 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-56436c9a-908c-42de-9406-a86d10d97b8a tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:27.550370 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-d24ad31a-34b4-4e13-a797-413e84342e41 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:27.558922 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-d24ad31a-34b4-4e13-a797-413e84342e41 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 200 len: 1735 microversion: 2.1 time: 0.149410 May 04 19:10:27.559689 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 291/573] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:27 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:10:27.587847 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-56436c9a-908c-42de-9406-a86d10d97b8a tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:27.595349 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-56436c9a-908c-42de-9406-a86d10d97b8a tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/50e3af6c-83e8-4320-8157-06ed4ef20cda" status: 200 len: 1615 microversion: 2.1 time: 0.083194 May 04 19:10:27.595915 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 283/574] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:27 2022] GET /compute/v2.1/servers/50e3af6c-83e8-4320-8157-06ed4ef20cda => generated 1615 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:10:28.092550 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-dffc82fe-999b-4572-84ae-77739b4e1766 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:28.093182 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-dffc82fe-999b-4572-84ae-77739b4e1766 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:28.099522 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-dffc82fe-999b-4572-84ae-77739b4e1766 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:28.099981 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-dffc82fe-999b-4572-84ae-77739b4e1766 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:28.100808 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-dffc82fe-999b-4572-84ae-77739b4e1766 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:28.101300 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-dffc82fe-999b-4572-84ae-77739b4e1766 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:28.245924 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-dffc82fe-999b-4572-84ae-77739b4e1766 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:28.254305 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-dffc82fe-999b-4572-84ae-77739b4e1766 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:28.255811 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-dffc82fe-999b-4572-84ae-77739b4e1766 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:28.256967 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-dffc82fe-999b-4572-84ae-77739b4e1766 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1724 microversion: 2.20 time: 0.168490 May 04 19:10:28.258271 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 292/575] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:10:28 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:10:28.575311 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-af8ea235-0839-402a-ad8e-5b92324613d3 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:28.575911 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-af8ea235-0839-402a-ad8e-5b92324613d3 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:28.582325 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-af8ea235-0839-402a-ad8e-5b92324613d3 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:28.582767 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-af8ea235-0839-402a-ad8e-5b92324613d3 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:28.583518 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-af8ea235-0839-402a-ad8e-5b92324613d3 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:28.583949 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-af8ea235-0839-402a-ad8e-5b92324613d3 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:28.611982 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-4dcf6293-3cc6-4730-bf74-06b7d56bcc80 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:28.612699 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-4dcf6293-3cc6-4730-bf74-06b7d56bcc80 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 50e3af6c-83e8-4320-8157-06ed4ef20cda] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:28.619725 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4dcf6293-3cc6-4730-bf74-06b7d56bcc80 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:28.620313 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4dcf6293-3cc6-4730-bf74-06b7d56bcc80 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:28.621069 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4dcf6293-3cc6-4730-bf74-06b7d56bcc80 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:28.621526 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4dcf6293-3cc6-4730-bf74-06b7d56bcc80 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:28.691544 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-4dcf6293-3cc6-4730-bf74-06b7d56bcc80 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:28.699401 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-4dcf6293-3cc6-4730-bf74-06b7d56bcc80 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/50e3af6c-83e8-4320-8157-06ed4ef20cda" status: 200 len: 1327 microversion: 2.1 time: 0.091113 May 04 19:10:28.700046 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 293/576] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:28 2022] GET /compute/v2.1/servers/50e3af6c-83e8-4320-8157-06ed4ef20cda => generated 1327 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:10:28.721105 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-af8ea235-0839-402a-ad8e-5b92324613d3 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:28.731619 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-af8ea235-0839-402a-ad8e-5b92324613d3 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 200 len: 1735 microversion: 2.1 time: 0.159974 May 04 19:10:28.732188 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 284/577] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:28 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:10:29.276631 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-2c26092e-74bb-49e8-b023-4ba3dacd7beb tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:29.277238 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-2c26092e-74bb-49e8-b023-4ba3dacd7beb tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:29.283045 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2c26092e-74bb-49e8-b023-4ba3dacd7beb tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:29.283490 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2c26092e-74bb-49e8-b023-4ba3dacd7beb tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:29.284239 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2c26092e-74bb-49e8-b023-4ba3dacd7beb tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:29.284674 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2c26092e-74bb-49e8-b023-4ba3dacd7beb tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:29.700775 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-2c26092e-74bb-49e8-b023-4ba3dacd7beb tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:29.708489 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-2c26092e-74bb-49e8-b023-4ba3dacd7beb tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:29.710036 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-2c26092e-74bb-49e8-b023-4ba3dacd7beb tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:29.711783 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-2c26092e-74bb-49e8-b023-4ba3dacd7beb tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1724 microversion: 2.20 time: 0.439550 May 04 19:10:29.712332 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 294/578] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:10:29 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1724 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:10:29.716529 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-e352e6d2-8d5b-4d1f-b382-e72d5d411dae tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:29.717171 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-e352e6d2-8d5b-4d1f-b382-e72d5d411dae tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 50e3af6c-83e8-4320-8157-06ed4ef20cda] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:29.724051 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e352e6d2-8d5b-4d1f-b382-e72d5d411dae tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:29.724498 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e352e6d2-8d5b-4d1f-b382-e72d5d411dae tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:29.725260 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e352e6d2-8d5b-4d1f-b382-e72d5d411dae tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:29.725740 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e352e6d2-8d5b-4d1f-b382-e72d5d411dae tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:29.748160 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-7016862a-cb10-454a-b677-b9ddaa1e4001 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:29.749108 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-7016862a-cb10-454a-b677-b9ddaa1e4001 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:29.755792 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7016862a-cb10-454a-b677-b9ddaa1e4001 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:29.756739 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7016862a-cb10-454a-b677-b9ddaa1e4001 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:29.758755 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7016862a-cb10-454a-b677-b9ddaa1e4001 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:29.760364 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7016862a-cb10-454a-b677-b9ddaa1e4001 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:29.770820 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e352e6d2-8d5b-4d1f-b382-e72d5d411dae tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:29.771263 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e352e6d2-8d5b-4d1f-b382-e72d5d411dae tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:29.771721 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.objects.instance [None req-e352e6d2-8d5b-4d1f-b382-e72d5d411dae tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lazy-loading 'fault' on Instance uuid 50e3af6c-83e8-4320-8157-06ed4ef20cda {{(pid=117125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 04 19:10:29.821624 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-e352e6d2-8d5b-4d1f-b382-e72d5d411dae tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:29.844164 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-e352e6d2-8d5b-4d1f-b382-e72d5d411dae tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/50e3af6c-83e8-4320-8157-06ed4ef20cda" status: 200 len: 1332 microversion: 2.1 time: 0.131337 May 04 19:10:29.854559 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 285/579] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:29 2022] GET /compute/v2.1/servers/50e3af6c-83e8-4320-8157-06ed4ef20cda => generated 1332 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:10:29.938092 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-7016862a-cb10-454a-b677-b9ddaa1e4001 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:29.946425 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-7016862a-cb10-454a-b677-b9ddaa1e4001 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 200 len: 1735 microversion: 2.1 time: 0.202315 May 04 19:10:29.946982 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 295/580] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:29 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 1735 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:10:30.730006 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-04955f30-9d77-4070-a742-3529e03e63e9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:30.730605 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-04955f30-9d77-4070-a742-3529e03e63e9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:30.736798 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-04955f30-9d77-4070-a742-3529e03e63e9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:30.737242 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-04955f30-9d77-4070-a742-3529e03e63e9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:30.738032 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-04955f30-9d77-4070-a742-3529e03e63e9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:30.738468 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-04955f30-9d77-4070-a742-3529e03e63e9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:30.805818 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-04955f30-9d77-4070-a742-3529e03e63e9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:30.815523 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-04955f30-9d77-4070-a742-3529e03e63e9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:30.818190 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-04955f30-9d77-4070-a742-3529e03e63e9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:30.819385 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-04955f30-9d77-4070-a742-3529e03e63e9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 200 len: 1657 microversion: 2.20 time: 0.093968 May 04 19:10:30.819929 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 286/581] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:10:30 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 1657 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:10:30.862131 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-4b0f2a0e-35b5-4c51-9446-c672ef11795d tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:30.862778 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-4b0f2a0e-35b5-4c51-9446-c672ef11795d tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 50e3af6c-83e8-4320-8157-06ed4ef20cda] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:30.869065 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4b0f2a0e-35b5-4c51-9446-c672ef11795d tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:30.869541 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4b0f2a0e-35b5-4c51-9446-c672ef11795d tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:30.870309 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4b0f2a0e-35b5-4c51-9446-c672ef11795d tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:30.870742 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4b0f2a0e-35b5-4c51-9446-c672ef11795d tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:30.884015 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.wsgi [None req-4b0f2a0e-35b5-4c51-9446-c672ef11795d tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] HTTP exception thrown: Instance 50e3af6c-83e8-4320-8157-06ed4ef20cda could not be found. May 04 19:10:30.884607 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-4b0f2a0e-35b5-4c51-9446-c672ef11795d tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Returning 404 to user: Instance 50e3af6c-83e8-4320-8157-06ed4ef20cda could not be found. {{(pid=117124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 04 19:10:30.885456 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-4b0f2a0e-35b5-4c51-9446-c672ef11795d tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/50e3af6c-83e8-4320-8157-06ed4ef20cda" status: 404 len: 111 microversion: 2.1 time: 0.027189 May 04 19:10:30.886005 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 296/582] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:30 2022] GET /compute/v2.1/servers/50e3af6c-83e8-4320-8157-06ed4ef20cda => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 04 19:10:30.896084 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-b9dd25a6-3eae-4054-a4c7-fee6f3d63e80 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '.version_select at 0x7fc3f61e8dc0>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:30.901436 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b9dd25a6-3eae-4054-a4c7-fee6f3d63e80 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [d0d1e593-b1fe-4654-866e-5b052258b1b6] AMQP server on 10.222.0.69:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 04 19:10:30.968807 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-f44a8695-0dfd-40a5-a4f7-a4a78fd5afe6 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:30.969912 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-f44a8695-0dfd-40a5-a4f7-a4a78fd5afe6 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:30.977695 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f44a8695-0dfd-40a5-a4f7-a4a78fd5afe6 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:30.978577 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f44a8695-0dfd-40a5-a4f7-a4a78fd5afe6 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:30.979595 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f44a8695-0dfd-40a5-a4f7-a4a78fd5afe6 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:30.980296 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f44a8695-0dfd-40a5-a4f7-a4a78fd5afe6 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:31.183773 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-f44a8695-0dfd-40a5-a4f7-a4a78fd5afe6 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:31.195826 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-f44a8695-0dfd-40a5-a4f7-a4a78fd5afe6 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 200 len: 1735 microversion: 2.1 time: 0.230819 May 04 19:10:31.207868 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 297/583] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:30 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 1735 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:10:31.214859 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-167c3caa-1a89-42f1-8851-eef66c625314 req-bc265559-5388-4213-b246-a28e59f79d03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f929e9e-51bf-477a-877b-6c162202c7f5", "name": "network-vif-deleted", "tag": "c2916343-9825-41ef-93c5-4b2dbc6d65a9"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:10:31.223762 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-167c3caa-1a89-42f1-8851-eef66c625314 req-bc265559-5388-4213-b246-a28e59f79d03 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:31.224557 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-167c3caa-1a89-42f1-8851-eef66c625314 req-bc265559-5388-4213-b246-a28e59f79d03 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:31.237140 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-167c3caa-1a89-42f1-8851-eef66c625314 req-bc265559-5388-4213-b246-a28e59f79d03 service nova] Creating event network-vif-deleted:c2916343-9825-41ef-93c5-4b2dbc6d65a9 for instance 8f929e9e-51bf-477a-877b-6c162202c7f5 on hv-cinder-83090 May 04 19:10:31.243785 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-167c3caa-1a89-42f1-8851-eef66c625314 req-bc265559-5388-4213-b246-a28e59f79d03 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034193 May 04 19:10:31.244579 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 298/584] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:10:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:10:31.837981 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-1652804d-b6b7-4f09-a169-84c76e21f5a9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:31.838693 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-1652804d-b6b7-4f09-a169-84c76e21f5a9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:31.845043 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1652804d-b6b7-4f09-a169-84c76e21f5a9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:31.845512 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1652804d-b6b7-4f09-a169-84c76e21f5a9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:31.846290 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1652804d-b6b7-4f09-a169-84c76e21f5a9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:31.846731 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1652804d-b6b7-4f09-a169-84c76e21f5a9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:31.860751 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.wsgi [None req-1652804d-b6b7-4f09-a169-84c76e21f5a9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] HTTP exception thrown: Instance 8f929e9e-51bf-477a-877b-6c162202c7f5 could not be found. May 04 19:10:31.861344 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-1652804d-b6b7-4f09-a169-84c76e21f5a9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Returning 404 to user: Instance 8f929e9e-51bf-477a-877b-6c162202c7f5 could not be found. {{(pid=117124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 04 19:10:31.862197 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-1652804d-b6b7-4f09-a169-84c76e21f5a9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 404 len: 111 microversion: 2.20 time: 0.028548 May 04 19:10:31.862746 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 299/585] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:10:31 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 04 19:10:31.871584 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-9e4c2954-eef9-4d9a-a1b8-329f681788a6 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '.version_select at 0x7fc3f6255700>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:31.890344 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-9e4c2954-eef9-4d9a-a1b8-329f681788a6 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-284955437" status: 204 len: 0 microversion: 2.20 time: 0.022425 May 04 19:10:31.891072 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 300/586] 10.222.0.69 () {60 vars in 1258 bytes} [Wed May 4 19:10:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-284955437 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 04 19:10:31.909214 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO oslo.messaging._drivers.impl_rabbit [None req-b9dd25a6-3eae-4054-a4c7-fee6f3d63e80 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [d0d1e593-b1fe-4654-866e-5b052258b1b6] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 33128. May 04 19:10:31.932841 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-b9dd25a6-3eae-4054-a4c7-fee6f3d63e80 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1531871535" status: 202 len: 0 microversion: 2.1 time: 1.042301 May 04 19:10:31.936707 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 287/587] 10.222.0.69 () {58 vars in 1220 bytes} [Wed May 4 19:10:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1531871535 => generated 0 bytes in 1044 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 04 19:10:32.216530 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-727de35f-411b-462a-bf6f-f4c7383f7ae4 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:32.218667 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-727de35f-411b-462a-bf6f-f4c7383f7ae4 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:32.230749 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-727de35f-411b-462a-bf6f-f4c7383f7ae4 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:32.231399 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-727de35f-411b-462a-bf6f-f4c7383f7ae4 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:32.234440 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-727de35f-411b-462a-bf6f-f4c7383f7ae4 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:32.235172 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-727de35f-411b-462a-bf6f-f4c7383f7ae4 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:32.492105 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-727de35f-411b-462a-bf6f-f4c7383f7ae4 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:32.500530 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-727de35f-411b-462a-bf6f-f4c7383f7ae4 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 200 len: 1735 microversion: 2.1 time: 0.288509 May 04 19:10:32.501966 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 301/588] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:32 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 1735 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:10:32.720911 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-17f75209-a516-4f7f-938d-8be931894bfb tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:32.721500 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-17f75209-a516-4f7f-938d-8be931894bfb tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: fae4a97e-a910-4f71-abf2-8f62425c6a52] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:32.727560 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-6d4223f5-f740-4e90-ae7e-9e8205d14f49 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Action: 'create', calling method: .version_select at 0x7fc3f62555e0>, body: {"keypair": {"name": "tempest-keypair-1378786842"}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:10:32.727962 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-17f75209-a516-4f7f-938d-8be931894bfb tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:32.728413 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-17f75209-a516-4f7f-938d-8be931894bfb tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:32.729217 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-17f75209-a516-4f7f-938d-8be931894bfb tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:32.729690 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-17f75209-a516-4f7f-938d-8be931894bfb tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:32.741042 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-6d4223f5-f740-4e90-ae7e-9e8205d14f49 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Getting quotas for project e7beef313fe3439db0866cfdb10fdbe2. Resources: {'key_pairs'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 04 19:10:32.744878 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-6d4223f5-f740-4e90-ae7e-9e8205d14f49 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Getting quotas for user 047fb46d1a764838bd8f8a44609a2e6f and project e7beef313fe3439db0866cfdb10fdbe2. Resources: {'key_pairs'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 04 19:10:32.806558 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.objects.instance [None req-17f75209-a516-4f7f-938d-8be931894bfb tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lazy-loading 'services' on Instance uuid fae4a97e-a910-4f71-abf2-8f62425c6a52 {{(pid=117125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 04 19:10:32.875063 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-17f75209-a516-4f7f-938d-8be931894bfb tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "DELETE /compute/v2.1/servers/fae4a97e-a910-4f71-abf2-8f62425c6a52/os-volume_attachments/95402f99-7bfa-4e95-9f62-d89ba73424fc" status: 202 len: 0 microversion: 2.1 time: 0.158033 May 04 19:10:32.875939 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 288/589] 10.222.0.69 () {58 vars in 1415 bytes} [Wed May 4 19:10:32 2022] DELETE /compute/v2.1/servers/fae4a97e-a910-4f71-abf2-8f62425c6a52/os-volume_attachments/95402f99-7bfa-4e95-9f62-d89ba73424fc => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 04 19:10:32.885792 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-0474fca5-a96b-4fc9-9049-92792bc7c67f tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:32.887782 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-0474fca5-a96b-4fc9-9049-92792bc7c67f tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: fae4a97e-a910-4f71-abf2-8f62425c6a52] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:32.894910 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0474fca5-a96b-4fc9-9049-92792bc7c67f tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:32.895457 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0474fca5-a96b-4fc9-9049-92792bc7c67f tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:32.896390 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0474fca5-a96b-4fc9-9049-92792bc7c67f tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:32.896829 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0474fca5-a96b-4fc9-9049-92792bc7c67f tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:32.926872 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-0474fca5-a96b-4fc9-9049-92792bc7c67f tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/fae4a97e-a910-4f71-abf2-8f62425c6a52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045996 May 04 19:10:32.927666 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 289/590] 10.222.0.69 () {58 vars in 1301 bytes} [Wed May 4 19:10:32 2022] GET /compute/v2.1/servers/fae4a97e-a910-4f71-abf2-8f62425c6a52/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 04 19:10:33.042860 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-6d4223f5-f740-4e90-ae7e-9e8205d14f49 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Getting quotas for project e7beef313fe3439db0866cfdb10fdbe2. Resources: {'key_pairs'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 04 19:10:33.046469 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-6d4223f5-f740-4e90-ae7e-9e8205d14f49 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Getting quotas for user 047fb46d1a764838bd8f8a44609a2e6f and project e7beef313fe3439db0866cfdb10fdbe2. Resources: {'key_pairs'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 04 19:10:33.059317 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-6d4223f5-f740-4e90-ae7e-9e8205d14f49 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.337213 May 04 19:10:33.059906 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 302/591] 10.222.0.69 () {62 vars in 1198 bytes} [Wed May 4 19:10:32 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 338 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) May 04 19:10:33.519384 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-346d6988-cdb5-4314-9920-5c0ec3c159f7 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:33.520171 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-346d6988-cdb5-4314-9920-5c0ec3c159f7 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:33.528366 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-346d6988-cdb5-4314-9920-5c0ec3c159f7 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:33.528878 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-346d6988-cdb5-4314-9920-5c0ec3c159f7 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:33.529824 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-346d6988-cdb5-4314-9920-5c0ec3c159f7 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:33.530428 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-346d6988-cdb5-4314-9920-5c0ec3c159f7 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:33.802277 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-346d6988-cdb5-4314-9920-5c0ec3c159f7 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:33.812269 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-346d6988-cdb5-4314-9920-5c0ec3c159f7 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 200 len: 1735 microversion: 2.1 time: 0.297463 May 04 19:10:33.813835 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 290/592] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:33 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 1735 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:10:33.938824 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-c2596d68-7f83-40c3-8139-62ce7d069077 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:33.939742 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-c2596d68-7f83-40c3-8139-62ce7d069077 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: fae4a97e-a910-4f71-abf2-8f62425c6a52] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:33.948649 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c2596d68-7f83-40c3-8139-62ce7d069077 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:33.949107 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c2596d68-7f83-40c3-8139-62ce7d069077 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:33.949921 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c2596d68-7f83-40c3-8139-62ce7d069077 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:33.950442 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c2596d68-7f83-40c3-8139-62ce7d069077 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:33.985601 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-c2596d68-7f83-40c3-8139-62ce7d069077 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/fae4a97e-a910-4f71-abf2-8f62425c6a52/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050663 May 04 19:10:33.986167 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 303/593] 10.222.0.69 () {58 vars in 1301 bytes} [Wed May 4 19:10:33 2022] GET /compute/v2.1/servers/fae4a97e-a910-4f71-abf2-8f62425c6a52/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 04 19:10:34.044007 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-500a1be5-52ac-439b-8e0e-707cc1b6da9a tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:34.044564 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-500a1be5-52ac-439b-8e0e-707cc1b6da9a tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: fae4a97e-a910-4f71-abf2-8f62425c6a52] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:34.050500 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-500a1be5-52ac-439b-8e0e-707cc1b6da9a tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:34.051025 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-500a1be5-52ac-439b-8e0e-707cc1b6da9a tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:34.051781 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-500a1be5-52ac-439b-8e0e-707cc1b6da9a tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:34.052212 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-500a1be5-52ac-439b-8e0e-707cc1b6da9a tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:34.078605 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-500a1be5-52ac-439b-8e0e-707cc1b6da9a tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: fae4a97e-a910-4f71-abf2-8f62425c6a52] Going to try to terminate instance {{(pid=117125) delete /opt/stack/nova/nova/compute/api.py:2664}} May 04 19:10:34.171083 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-500a1be5-52ac-439b-8e0e-707cc1b6da9a tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "DELETE /compute/v2.1/servers/fae4a97e-a910-4f71-abf2-8f62425c6a52" status: 204 len: 0 microversion: 2.1 time: 0.130552 May 04 19:10:34.171884 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 291/594] 10.222.0.69 () {58 vars in 1238 bytes} [Wed May 4 19:10:34 2022] DELETE /compute/v2.1/servers/fae4a97e-a910-4f71-abf2-8f62425c6a52 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 04 19:10:34.180913 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-1d384307-ac1c-4338-aa8c-f9691566a180 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:34.181611 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-1d384307-ac1c-4338-aa8c-f9691566a180 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: fae4a97e-a910-4f71-abf2-8f62425c6a52] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:34.188627 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1d384307-ac1c-4338-aa8c-f9691566a180 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:34.189724 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1d384307-ac1c-4338-aa8c-f9691566a180 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:34.191139 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1d384307-ac1c-4338-aa8c-f9691566a180 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:34.191758 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1d384307-ac1c-4338-aa8c-f9691566a180 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:34.344345 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-1d384307-ac1c-4338-aa8c-f9691566a180 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:34.351773 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-1d384307-ac1c-4338-aa8c-f9691566a180 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/fae4a97e-a910-4f71-abf2-8f62425c6a52" status: 200 len: 1682 microversion: 2.1 time: 0.175187 May 04 19:10:34.352343 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 304/595] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:34 2022] GET /compute/v2.1/servers/fae4a97e-a910-4f71-abf2-8f62425c6a52 => generated 1682 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:10:34.571278 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-91a95124-b242-4b3e-93be-cc953872d428 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-566948933", "imageRef": "2869595e-cda4-45af-aaeb-0779eb5f4114", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3a2f1e63-50e7-4268-b40e-fc952c337bb5"}], "security_groups": [{"name": "tempest-securitygroup--921328187"}], "key_name": "tempest-keypair-1378786842", "user_data": "}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:10:34.674994 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.network.neutron [None req-91a95124-b242-4b3e-93be-cc953872d428 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] validate_networks() for [('3a2f1e63-50e7-4268-b40e-fc952c337bb5', None, None, None, None, None)] {{(pid=117125) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 04 19:10:34.831309 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-4957a679-47de-47aa-bf6e-05827e65ced9 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:34.832122 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-4957a679-47de-47aa-bf6e-05827e65ced9 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:34.838569 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4957a679-47de-47aa-bf6e-05827e65ced9 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:34.839754 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4957a679-47de-47aa-bf6e-05827e65ced9 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:34.839754 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4957a679-47de-47aa-bf6e-05827e65ced9 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:34.840189 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4957a679-47de-47aa-bf6e-05827e65ced9 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:34.980690 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-4957a679-47de-47aa-bf6e-05827e65ced9 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:34.988676 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-4957a679-47de-47aa-bf6e-05827e65ced9 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 200 len: 1735 microversion: 2.1 time: 0.161557 May 04 19:10:34.989495 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 305/596] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:34 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:10:35.062123 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-91a95124-b242-4b3e-93be-cc953872d428 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Flavor limits 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 04 19:10:35.062586 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-91a95124-b242-4b3e-93be-cc953872d428 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Image limits 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 04 19:10:35.063019 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-91a95124-b242-4b3e-93be-cc953872d428 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Flavor pref 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 04 19:10:35.063453 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-91a95124-b242-4b3e-93be-cc953872d428 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Image pref 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 04 19:10:35.063863 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-91a95124-b242-4b3e-93be-cc953872d428 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 04 19:10:35.072865 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-91a95124-b242-4b3e-93be-cc953872d428 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:35.073325 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-91a95124-b242-4b3e-93be-cc953872d428 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:35.074157 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-91a95124-b242-4b3e-93be-cc953872d428 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:35.074598 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-91a95124-b242-4b3e-93be-cc953872d428 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:35.090731 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-91a95124-b242-4b3e-93be-cc953872d428 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Getting quotas for project e7beef313fe3439db0866cfdb10fdbe2. Resources: {'cores', 'ram', 'instances'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 04 19:10:35.094587 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-91a95124-b242-4b3e-93be-cc953872d428 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Getting quotas for user 047fb46d1a764838bd8f8a44609a2e6f and project e7beef313fe3439db0866cfdb10fdbe2. Resources: {'cores', 'ram', 'instances'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 04 19:10:35.105883 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-91a95124-b242-4b3e-93be-cc953872d428 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Going to run 1 instances... {{(pid=117125) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 04 19:10:35.108241 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-91a95124-b242-4b3e-93be-cc953872d428 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2869595e-cda4-45af-aaeb-0779eb5f4114',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 04 19:10:35.160081 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-91a95124-b242-4b3e-93be-cc953872d428 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.593985 May 04 19:10:35.160901 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 292/597] 10.222.0.69 () {62 vars in 1187 bytes} [Wed May 4 19:10:34 2022] POST /compute/v2.1/servers => generated 401 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 04 19:10:35.171474 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-df4f8935-44b6-49f4-b77e-722e7a7c8156 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:35.172423 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-df4f8935-44b6-49f4-b77e-722e7a7c8156 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:35.238498 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-df4f8935-44b6-49f4-b77e-722e7a7c8156 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:35.247190 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-df4f8935-44b6-49f4-b77e-722e7a7c8156 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:35.248708 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-df4f8935-44b6-49f4-b77e-722e7a7c8156 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:35.250007 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-df4f8935-44b6-49f4-b77e-722e7a7c8156 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1281 microversion: 2.20 time: 0.082355 May 04 19:10:35.250733 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 306/598] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:10:35 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1281 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:10:35.375672 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-c345666a-3cc2-4318-9c12-f51d77cdb970 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:35.375672 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-c345666a-3cc2-4318-9c12-f51d77cdb970 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: fae4a97e-a910-4f71-abf2-8f62425c6a52] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:35.379434 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c345666a-3cc2-4318-9c12-f51d77cdb970 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:35.380122 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c345666a-3cc2-4318-9c12-f51d77cdb970 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:35.381095 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c345666a-3cc2-4318-9c12-f51d77cdb970 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:35.381774 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c345666a-3cc2-4318-9c12-f51d77cdb970 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:35.520064 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-c345666a-3cc2-4318-9c12-f51d77cdb970 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:35.528226 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-c345666a-3cc2-4318-9c12-f51d77cdb970 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/fae4a97e-a910-4f71-abf2-8f62425c6a52" status: 200 len: 1682 microversion: 2.1 time: 0.163919 May 04 19:10:35.528809 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 293/599] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:35 2022] GET /compute/v2.1/servers/fae4a97e-a910-4f71-abf2-8f62425c6a52 => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:10:36.006490 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-ae76d9c3-be4c-48ed-aec2-7c68480569c0 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:36.007818 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-ae76d9c3-be4c-48ed-aec2-7c68480569c0 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:36.015036 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ae76d9c3-be4c-48ed-aec2-7c68480569c0 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:36.015483 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ae76d9c3-be4c-48ed-aec2-7c68480569c0 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:36.016247 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ae76d9c3-be4c-48ed-aec2-7c68480569c0 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:36.016940 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ae76d9c3-be4c-48ed-aec2-7c68480569c0 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:36.182263 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-ae76d9c3-be4c-48ed-aec2-7c68480569c0 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:36.190286 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-ae76d9c3-be4c-48ed-aec2-7c68480569c0 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 200 len: 1735 microversion: 2.1 time: 0.187973 May 04 19:10:36.190850 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 307/600] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:36 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 1735 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:10:36.268602 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-640b22f8-f934-44f9-bd82-721d24b5d0dd tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:36.269232 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-640b22f8-f934-44f9-bd82-721d24b5d0dd tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:36.275548 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-640b22f8-f934-44f9-bd82-721d24b5d0dd tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:36.275983 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-640b22f8-f934-44f9-bd82-721d24b5d0dd tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:36.276738 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-640b22f8-f934-44f9-bd82-721d24b5d0dd tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:36.277171 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-640b22f8-f934-44f9-bd82-721d24b5d0dd tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:36.341715 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-640b22f8-f934-44f9-bd82-721d24b5d0dd tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:36.349703 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-640b22f8-f934-44f9-bd82-721d24b5d0dd tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:36.352470 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-640b22f8-f934-44f9-bd82-721d24b5d0dd tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:36.353655 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-640b22f8-f934-44f9-bd82-721d24b5d0dd tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1333 microversion: 2.20 time: 0.089397 May 04 19:10:36.354228 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 294/601] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:10:36 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1333 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:10:36.546688 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-ad902721-2ca1-400e-b79f-278b3d62e078 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:36.548043 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-ad902721-2ca1-400e-b79f-278b3d62e078 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: fae4a97e-a910-4f71-abf2-8f62425c6a52] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:36.555374 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ad902721-2ca1-400e-b79f-278b3d62e078 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:36.556209 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ad902721-2ca1-400e-b79f-278b3d62e078 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:36.557257 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ad902721-2ca1-400e-b79f-278b3d62e078 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:36.557947 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ad902721-2ca1-400e-b79f-278b3d62e078 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:36.870580 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-ad902721-2ca1-400e-b79f-278b3d62e078 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:36.878226 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-ad902721-2ca1-400e-b79f-278b3d62e078 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/fae4a97e-a910-4f71-abf2-8f62425c6a52" status: 200 len: 1682 microversion: 2.1 time: 0.335365 May 04 19:10:36.879121 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 308/602] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:36 2022] GET /compute/v2.1/servers/fae4a97e-a910-4f71-abf2-8f62425c6a52 => generated 1682 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:10:37.208216 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-ab71d655-52d3-49f0-a1fd-b33b4023efd8 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:37.208835 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-ab71d655-52d3-49f0-a1fd-b33b4023efd8 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:37.215752 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ab71d655-52d3-49f0-a1fd-b33b4023efd8 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:37.216199 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ab71d655-52d3-49f0-a1fd-b33b4023efd8 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:37.216975 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ab71d655-52d3-49f0-a1fd-b33b4023efd8 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:37.217412 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ab71d655-52d3-49f0-a1fd-b33b4023efd8 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:37.348458 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-ab71d655-52d3-49f0-a1fd-b33b4023efd8 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:37.356313 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-ab71d655-52d3-49f0-a1fd-b33b4023efd8 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 200 len: 1735 microversion: 2.1 time: 0.151967 May 04 19:10:37.366664 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 295/603] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:37 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:10:37.371365 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-ab536a7b-77e6-4e25-9e1f-c8e2ed601c0d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:37.371971 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-ab536a7b-77e6-4e25-9e1f-c8e2ed601c0d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:37.377701 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ab536a7b-77e6-4e25-9e1f-c8e2ed601c0d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:37.378148 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ab536a7b-77e6-4e25-9e1f-c8e2ed601c0d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:37.378907 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ab536a7b-77e6-4e25-9e1f-c8e2ed601c0d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:37.379339 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ab536a7b-77e6-4e25-9e1f-c8e2ed601c0d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:37.471375 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-ab536a7b-77e6-4e25-9e1f-c8e2ed601c0d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:37.479220 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-ab536a7b-77e6-4e25-9e1f-c8e2ed601c0d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:37.480740 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-ab536a7b-77e6-4e25-9e1f-c8e2ed601c0d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:37.481863 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-ab536a7b-77e6-4e25-9e1f-c8e2ed601c0d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1339 microversion: 2.20 time: 0.114388 May 04 19:10:37.482421 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 309/604] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:10:37 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1339 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:10:37.896693 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-edf223cd-3ba2-4551-bc30-61b6ff582b4b tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:37.897713 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-edf223cd-3ba2-4551-bc30-61b6ff582b4b tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: fae4a97e-a910-4f71-abf2-8f62425c6a52] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:37.905174 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-edf223cd-3ba2-4551-bc30-61b6ff582b4b tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:37.906044 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-edf223cd-3ba2-4551-bc30-61b6ff582b4b tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:37.907121 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-edf223cd-3ba2-4551-bc30-61b6ff582b4b tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:37.908040 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-edf223cd-3ba2-4551-bc30-61b6ff582b4b tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:37.979231 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-bc6ceeca-437c-4b3d-80d4-da76d50c8266 req-f1812e1f-7e7b-4351-8727-0bc3d4de30f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fae4a97e-a910-4f71-abf2-8f62425c6a52", "name": "network-vif-deleted", "tag": "8a90cb33-99be-414d-99e2-31861f252bb4"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:10:37.999399 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-bc6ceeca-437c-4b3d-80d4-da76d50c8266 req-f1812e1f-7e7b-4351-8727-0bc3d4de30f1 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:38.000493 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-bc6ceeca-437c-4b3d-80d4-da76d50c8266 req-f1812e1f-7e7b-4351-8727-0bc3d4de30f1 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:38.019430 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-edf223cd-3ba2-4551-bc30-61b6ff582b4b tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:38.029361 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-bc6ceeca-437c-4b3d-80d4-da76d50c8266 req-f1812e1f-7e7b-4351-8727-0bc3d4de30f1 service nova] Creating event network-vif-deleted:8a90cb33-99be-414d-99e2-31861f252bb4 for instance fae4a97e-a910-4f71-abf2-8f62425c6a52 on hv-cinder-83090 May 04 19:10:38.030857 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-edf223cd-3ba2-4551-bc30-61b6ff582b4b tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/fae4a97e-a910-4f71-abf2-8f62425c6a52" status: 200 len: 1614 microversion: 2.1 time: 0.139103 May 04 19:10:38.033134 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 296/605] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:37 2022] GET /compute/v2.1/servers/fae4a97e-a910-4f71-abf2-8f62425c6a52 => generated 1614 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:10:38.045315 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-bc6ceeca-437c-4b3d-80d4-da76d50c8266 req-f1812e1f-7e7b-4351-8727-0bc3d4de30f1 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070929 May 04 19:10:38.046501 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 310/606] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:10:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:10:38.374021 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-73b69e35-6e8d-4cf4-a564-23a337553be5 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:38.374566 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-73b69e35-6e8d-4cf4-a564-23a337553be5 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:38.381836 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-73b69e35-6e8d-4cf4-a564-23a337553be5 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:38.382282 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-73b69e35-6e8d-4cf4-a564-23a337553be5 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:38.383055 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-73b69e35-6e8d-4cf4-a564-23a337553be5 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:38.383486 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-73b69e35-6e8d-4cf4-a564-23a337553be5 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:38.500816 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-fea38d26-48d0-422e-9275-1a764460f153 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:38.501886 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-fea38d26-48d0-422e-9275-1a764460f153 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:38.508407 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fea38d26-48d0-422e-9275-1a764460f153 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:38.508927 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fea38d26-48d0-422e-9275-1a764460f153 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:38.509790 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fea38d26-48d0-422e-9275-1a764460f153 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:38.510292 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fea38d26-48d0-422e-9275-1a764460f153 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:38.510736 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-73b69e35-6e8d-4cf4-a564-23a337553be5 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:38.519393 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-73b69e35-6e8d-4cf4-a564-23a337553be5 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 200 len: 1735 microversion: 2.1 time: 0.149180 May 04 19:10:38.520070 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 297/607] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:38 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:10:38.649618 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-fea38d26-48d0-422e-9275-1a764460f153 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:38.658401 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-fea38d26-48d0-422e-9275-1a764460f153 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:38.659925 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-fea38d26-48d0-422e-9275-1a764460f153 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:38.661057 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-fea38d26-48d0-422e-9275-1a764460f153 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1406 microversion: 2.20 time: 0.164552 May 04 19:10:38.667657 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 311/608] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:10:38 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 04 19:10:39.050345 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-2a95ac53-4002-4f6e-80d5-8118e0788278 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:39.050950 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-2a95ac53-4002-4f6e-80d5-8118e0788278 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: fae4a97e-a910-4f71-abf2-8f62425c6a52] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:39.057297 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2a95ac53-4002-4f6e-80d5-8118e0788278 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:39.057780 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2a95ac53-4002-4f6e-80d5-8118e0788278 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:39.058527 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2a95ac53-4002-4f6e-80d5-8118e0788278 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:39.058954 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2a95ac53-4002-4f6e-80d5-8118e0788278 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:39.122156 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-2a95ac53-4002-4f6e-80d5-8118e0788278 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:39.129308 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-2a95ac53-4002-4f6e-80d5-8118e0788278 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/fae4a97e-a910-4f71-abf2-8f62425c6a52" status: 200 len: 1614 microversion: 2.1 time: 0.082838 May 04 19:10:39.129918 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 298/609] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:39 2022] GET /compute/v2.1/servers/fae4a97e-a910-4f71-abf2-8f62425c6a52 => generated 1614 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:10:39.536416 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-0f845fdf-f882-4969-bb3d-c8b517870f32 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:39.537133 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-0f845fdf-f882-4969-bb3d-c8b517870f32 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:39.544112 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0f845fdf-f882-4969-bb3d-c8b517870f32 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:39.544633 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0f845fdf-f882-4969-bb3d-c8b517870f32 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:39.545474 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0f845fdf-f882-4969-bb3d-c8b517870f32 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:39.545983 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0f845fdf-f882-4969-bb3d-c8b517870f32 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:39.679465 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-defb863f-2ab0-49e0-9fd9-488695c31f45 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:39.680664 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-defb863f-2ab0-49e0-9fd9-488695c31f45 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:39.687454 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-defb863f-2ab0-49e0-9fd9-488695c31f45 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:39.688071 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-defb863f-2ab0-49e0-9fd9-488695c31f45 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:39.688999 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-defb863f-2ab0-49e0-9fd9-488695c31f45 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:39.689735 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-defb863f-2ab0-49e0-9fd9-488695c31f45 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:39.758916 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-0f845fdf-f882-4969-bb3d-c8b517870f32 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:39.769720 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-0f845fdf-f882-4969-bb3d-c8b517870f32 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 200 len: 1735 microversion: 2.1 time: 0.236959 May 04 19:10:39.771579 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 312/610] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:39 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 1735 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:10:39.851834 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-defb863f-2ab0-49e0-9fd9-488695c31f45 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:39.860843 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-defb863f-2ab0-49e0-9fd9-488695c31f45 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:39.862470 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-defb863f-2ab0-49e0-9fd9-488695c31f45 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:39.863782 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-defb863f-2ab0-49e0-9fd9-488695c31f45 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1406 microversion: 2.20 time: 0.188961 May 04 19:10:39.864458 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 299/611] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:10:39 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1406 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 04 19:10:40.146819 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-3f48e8ac-91e0-4d1f-963f-95e92e40a510 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:40.148025 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-3f48e8ac-91e0-4d1f-963f-95e92e40a510 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: fae4a97e-a910-4f71-abf2-8f62425c6a52] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:40.149916 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-1e3cc98b-7c2a-40a0-9296-60c950e013ec req-ad167cf7-b47a-4d54-bdb5-c76058adde62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc9f6260-f308-4f45-809e-40f50eeb47d6", "tag": "7d596d4a-07a6-43a1-bc43-abfd6db7c370"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:10:40.163093 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3f48e8ac-91e0-4d1f-963f-95e92e40a510 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:40.163548 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3f48e8ac-91e0-4d1f-963f-95e92e40a510 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:40.164332 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3f48e8ac-91e0-4d1f-963f-95e92e40a510 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:40.164774 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3f48e8ac-91e0-4d1f-963f-95e92e40a510 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:40.169534 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-1e3cc98b-7c2a-40a0-9296-60c950e013ec req-ad167cf7-b47a-4d54-bdb5-c76058adde62 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:40.169893 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-1e3cc98b-7c2a-40a0-9296-60c950e013ec req-ad167cf7-b47a-4d54-bdb5-c76058adde62 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:40.179585 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.wsgi [None req-3f48e8ac-91e0-4d1f-963f-95e92e40a510 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] HTTP exception thrown: Instance fae4a97e-a910-4f71-abf2-8f62425c6a52 could not be found. May 04 19:10:40.180333 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-3f48e8ac-91e0-4d1f-963f-95e92e40a510 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Returning 404 to user: Instance fae4a97e-a910-4f71-abf2-8f62425c6a52 could not be found. {{(pid=117125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 04 19:10:40.181881 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-3f48e8ac-91e0-4d1f-963f-95e92e40a510 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/fae4a97e-a910-4f71-abf2-8f62425c6a52" status: 404 len: 111 microversion: 2.1 time: 0.038220 May 04 19:10:40.182540 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 300/612] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:40 2022] GET /compute/v2.1/servers/fae4a97e-a910-4f71-abf2-8f62425c6a52 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 04 19:10:40.182912 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-1e3cc98b-7c2a-40a0-9296-60c950e013ec req-ad167cf7-b47a-4d54-bdb5-c76058adde62 service nova] Creating event network-changed:7d596d4a-07a6-43a1-bc43-abfd6db7c370 for instance bc9f6260-f308-4f45-809e-40f50eeb47d6 on hv-cinder-83090 May 04 19:10:40.187881 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-1e3cc98b-7c2a-40a0-9296-60c950e013ec req-ad167cf7-b47a-4d54-bdb5-c76058adde62 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048551 May 04 19:10:40.188769 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 313/613] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:10:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:10:40.191967 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-0fe8b64f-b68e-478f-bb1d-672f15eac339 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '.version_select at 0x7fc3f62574c0>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:40.211288 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-0fe8b64f-b68e-478f-bb1d-672f15eac339 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-106439882" status: 202 len: 0 microversion: 2.1 time: 0.024218 May 04 19:10:40.212221 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 301/614] 10.222.0.69 () {58 vars in 1217 bytes} [Wed May 4 19:10:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-106439882 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 04 19:10:40.789031 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-df4a7378-ce29-4b80-8586-461026a66172 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:40.789753 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-df4a7378-ce29-4b80-8586-461026a66172 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:40.796104 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-df4a7378-ce29-4b80-8586-461026a66172 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:40.796554 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-df4a7378-ce29-4b80-8586-461026a66172 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:40.797312 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-df4a7378-ce29-4b80-8586-461026a66172 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:40.797777 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-df4a7378-ce29-4b80-8586-461026a66172 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:40.797973 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-258e427c-4eb2-420c-84e9-c8c2b707a5ea tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Action: 'create', calling method: .version_select at 0x7fc3f61b7b80>, body: {"keypair": {"name": "tempest-keypair-2035057183"}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:10:40.813686 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-258e427c-4eb2-420c-84e9-c8c2b707a5ea tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Getting quotas for project ef1ba9318cf84308a3ff6ce6da85755d. Resources: {'key_pairs'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 04 19:10:40.818115 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-258e427c-4eb2-420c-84e9-c8c2b707a5ea tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Getting quotas for user 98211cfafca84542a64f8b3f0b34303b and project ef1ba9318cf84308a3ff6ce6da85755d. Resources: {'key_pairs'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 04 19:10:40.885807 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-258e427c-4eb2-420c-84e9-c8c2b707a5ea tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Getting quotas for project ef1ba9318cf84308a3ff6ce6da85755d. Resources: {'key_pairs'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 04 19:10:40.890360 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-258e427c-4eb2-420c-84e9-c8c2b707a5ea tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Getting quotas for user 98211cfafca84542a64f8b3f0b34303b and project ef1ba9318cf84308a3ff6ce6da85755d. Resources: {'key_pairs'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 04 19:10:40.907536 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-258e427c-4eb2-420c-84e9-c8c2b707a5ea tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.113668 May 04 19:10:40.908139 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 302/615] 10.222.0.69 () {60 vars in 1157 bytes} [Wed May 4 19:10:40 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:10:40.912664 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-12dfcf34-41be-49d7-b6ca-f6e8853a8e3a tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:40.913846 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-12dfcf34-41be-49d7-b6ca-f6e8853a8e3a tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:40.923577 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-12dfcf34-41be-49d7-b6ca-f6e8853a8e3a tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:40.924063 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-12dfcf34-41be-49d7-b6ca-f6e8853a8e3a tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:40.924842 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-12dfcf34-41be-49d7-b6ca-f6e8853a8e3a tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:40.925280 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-12dfcf34-41be-49d7-b6ca-f6e8853a8e3a tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:40.943427 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-df4a7378-ce29-4b80-8586-461026a66172 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:40.952954 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-df4a7378-ce29-4b80-8586-461026a66172 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 200 len: 1735 microversion: 2.1 time: 0.168337 May 04 19:10:40.953729 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 314/616] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:40 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:10:41.128310 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-12dfcf34-41be-49d7-b6ca-f6e8853a8e3a tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:41.136427 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-12dfcf34-41be-49d7-b6ca-f6e8853a8e3a tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:41.137964 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-12dfcf34-41be-49d7-b6ca-f6e8853a8e3a tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:41.139089 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-12dfcf34-41be-49d7-b6ca-f6e8853a8e3a tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1406 microversion: 2.20 time: 0.230025 May 04 19:10:41.139636 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 303/617] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:10:40 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1406 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:10:41.970820 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-6469da1c-b160-4e86-b9e7-1e8e7c7d8268 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:41.971517 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-6469da1c-b160-4e86-b9e7-1e8e7c7d8268 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:41.977925 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6469da1c-b160-4e86-b9e7-1e8e7c7d8268 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:41.978374 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6469da1c-b160-4e86-b9e7-1e8e7c7d8268 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:41.979140 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6469da1c-b160-4e86-b9e7-1e8e7c7d8268 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:41.979571 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6469da1c-b160-4e86-b9e7-1e8e7c7d8268 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:42.157546 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-cea4511b-4d8f-4396-80d9-3d874f81673f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:42.158768 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-cea4511b-4d8f-4396-80d9-3d874f81673f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:42.165069 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cea4511b-4d8f-4396-80d9-3d874f81673f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:42.165844 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cea4511b-4d8f-4396-80d9-3d874f81673f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:42.166771 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cea4511b-4d8f-4396-80d9-3d874f81673f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:42.167264 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cea4511b-4d8f-4396-80d9-3d874f81673f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:42.251137 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-6469da1c-b160-4e86-b9e7-1e8e7c7d8268 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:42.265720 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-6469da1c-b160-4e86-b9e7-1e8e7c7d8268 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 200 len: 1735 microversion: 2.1 time: 0.298595 May 04 19:10:42.266915 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 315/618] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:41 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 1735 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:10:42.316890 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-cea4511b-4d8f-4396-80d9-3d874f81673f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:42.326754 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-cea4511b-4d8f-4396-80d9-3d874f81673f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:42.328134 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-cea4511b-4d8f-4396-80d9-3d874f81673f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:42.329309 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-cea4511b-4d8f-4396-80d9-3d874f81673f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1406 microversion: 2.20 time: 0.175813 May 04 19:10:42.330367 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 304/619] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:10:42 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 04 19:10:42.983341 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-f7e5c435-05f8-45e5-9c56-fad82f173f96 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1338058070", "imageRef": "2869595e-cda4-45af-aaeb-0779eb5f4114", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "52743f3b-665f-4119-9451-8ab735a2cc02"}], "security_groups": [{"name": "tempest-securitygroup--172054216"}], "key_name": "tempest-keypair-2035057183", "user_data": "}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:10:43.090146 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.network.neutron [None req-f7e5c435-05f8-45e5-9c56-fad82f173f96 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] validate_networks() for [('52743f3b-665f-4119-9451-8ab735a2cc02', None, None, None, None, None)] {{(pid=117124) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 04 19:10:43.283442 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-e1fa1165-8de5-42c4-b900-a988a1894c65 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:43.284189 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-e1fa1165-8de5-42c4-b900-a988a1894c65 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:43.290885 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e1fa1165-8de5-42c4-b900-a988a1894c65 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:43.291539 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e1fa1165-8de5-42c4-b900-a988a1894c65 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:43.292373 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e1fa1165-8de5-42c4-b900-a988a1894c65 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:43.292879 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e1fa1165-8de5-42c4-b900-a988a1894c65 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:43.436125 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-e1fa1165-8de5-42c4-b900-a988a1894c65 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:43.444707 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-e1fa1165-8de5-42c4-b900-a988a1894c65 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 200 len: 1735 microversion: 2.1 time: 0.165119 May 04 19:10:43.445696 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 305/620] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:43 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:10:43.460238 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-fbc372ed-2337-4fae-b24c-26bc39a28a36 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:43.461083 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-fbc372ed-2337-4fae-b24c-26bc39a28a36 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:43.467138 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-fbc372ed-2337-4fae-b24c-26bc39a28a36 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:43.467844 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-fbc372ed-2337-4fae-b24c-26bc39a28a36 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:43.469041 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-fbc372ed-2337-4fae-b24c-26bc39a28a36 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:43.469719 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-fbc372ed-2337-4fae-b24c-26bc39a28a36 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:43.499351 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-f7e5c435-05f8-45e5-9c56-fad82f173f96 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Flavor limits 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 04 19:10:43.500511 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-f7e5c435-05f8-45e5-9c56-fad82f173f96 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Image limits 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 04 19:10:43.501139 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-f7e5c435-05f8-45e5-9c56-fad82f173f96 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Flavor pref 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 04 19:10:43.502919 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-f7e5c435-05f8-45e5-9c56-fad82f173f96 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Image pref 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 04 19:10:43.503492 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-f7e5c435-05f8-45e5-9c56-fad82f173f96 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 04 19:10:43.515757 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f7e5c435-05f8-45e5-9c56-fad82f173f96 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:43.516438 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f7e5c435-05f8-45e5-9c56-fad82f173f96 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:43.517695 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f7e5c435-05f8-45e5-9c56-fad82f173f96 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:43.518465 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f7e5c435-05f8-45e5-9c56-fad82f173f96 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:43.536870 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-f7e5c435-05f8-45e5-9c56-fad82f173f96 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Getting quotas for project ef1ba9318cf84308a3ff6ce6da85755d. Resources: {'cores', 'ram', 'instances'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 04 19:10:43.541793 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-f7e5c435-05f8-45e5-9c56-fad82f173f96 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Getting quotas for user 98211cfafca84542a64f8b3f0b34303b and project ef1ba9318cf84308a3ff6ce6da85755d. Resources: {'cores', 'ram', 'instances'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 04 19:10:43.567133 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-f7e5c435-05f8-45e5-9c56-fad82f173f96 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Going to run 1 instances... {{(pid=117124) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 04 19:10:43.570042 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-f7e5c435-05f8-45e5-9c56-fad82f173f96 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 81874ac9-ec8c-4fb1-bd75-762920f7042d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2869595e-cda4-45af-aaeb-0779eb5f4114',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 04 19:10:43.626075 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-fbc372ed-2337-4fae-b24c-26bc39a28a36 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:43.626424 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-f7e5c435-05f8-45e5-9c56-fad82f173f96 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.648132 May 04 19:10:43.628074 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 316/621] 10.222.0.69 () {60 vars in 1146 bytes} [Wed May 4 19:10:42 2022] POST /compute/v2.1/servers => generated 401 bytes in 650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 04 19:10:43.639724 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-2e2e5d4d-75f2-4cfb-8f94-9449819f7828 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:43.640132 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-fbc372ed-2337-4fae-b24c-26bc39a28a36 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:43.642121 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-fbc372ed-2337-4fae-b24c-26bc39a28a36 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:43.643429 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-2e2e5d4d-75f2-4cfb-8f94-9449819f7828 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 81874ac9-ec8c-4fb1-bd75-762920f7042d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:43.643553 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-fbc372ed-2337-4fae-b24c-26bc39a28a36 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1406 microversion: 2.20 time: 0.187651 May 04 19:10:43.645334 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 306/622] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:10:43 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1406 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:10:43.711688 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-2e2e5d4d-75f2-4cfb-8f94-9449819f7828 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:43.718265 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-2e2e5d4d-75f2-4cfb-8f94-9449819f7828 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/81874ac9-ec8c-4fb1-bd75-762920f7042d" status: 200 len: 1242 microversion: 2.1 time: 0.083096 May 04 19:10:43.719226 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 317/623] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:43 2022] GET /compute/v2.1/servers/81874ac9-ec8c-4fb1-bd75-762920f7042d => generated 1242 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:10:44.462370 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-b376949f-0f93-4c1c-824c-303329208c12 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:44.462976 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-b376949f-0f93-4c1c-824c-303329208c12 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:44.469234 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b376949f-0f93-4c1c-824c-303329208c12 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:44.469715 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b376949f-0f93-4c1c-824c-303329208c12 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:44.470489 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b376949f-0f93-4c1c-824c-303329208c12 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:44.470922 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b376949f-0f93-4c1c-824c-303329208c12 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:44.662278 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-b1eb501f-b2c0-4aee-8f63-ed31c221e8f2 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:44.663034 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-b1eb501f-b2c0-4aee-8f63-ed31c221e8f2 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:44.669664 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b1eb501f-b2c0-4aee-8f63-ed31c221e8f2 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:44.670110 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b1eb501f-b2c0-4aee-8f63-ed31c221e8f2 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:44.670904 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b1eb501f-b2c0-4aee-8f63-ed31c221e8f2 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:44.671329 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b1eb501f-b2c0-4aee-8f63-ed31c221e8f2 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:44.738694 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-b376949f-0f93-4c1c-824c-303329208c12 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:44.758517 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-b376949f-0f93-4c1c-824c-303329208c12 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 200 len: 1735 microversion: 2.1 time: 0.300268 May 04 19:10:44.759598 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 307/624] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:44 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 1735 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:10:44.768005 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-9f535898-43aa-4705-8b53-3555fa155b4b tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:44.775624 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-9f535898-43aa-4705-8b53-3555fa155b4b tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 81874ac9-ec8c-4fb1-bd75-762920f7042d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:44.782570 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9f535898-43aa-4705-8b53-3555fa155b4b tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:44.789566 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9f535898-43aa-4705-8b53-3555fa155b4b tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:44.790605 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9f535898-43aa-4705-8b53-3555fa155b4b tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:44.791252 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9f535898-43aa-4705-8b53-3555fa155b4b tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:44.958201 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-9f535898-43aa-4705-8b53-3555fa155b4b tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:44.966829 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-9f535898-43aa-4705-8b53-3555fa155b4b tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/81874ac9-ec8c-4fb1-bd75-762920f7042d" status: 200 len: 1312 microversion: 2.1 time: 0.206092 May 04 19:10:44.967620 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 308/625] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:44 2022] GET /compute/v2.1/servers/81874ac9-ec8c-4fb1-bd75-762920f7042d => generated 1312 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:10:44.990898 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-b1eb501f-b2c0-4aee-8f63-ed31c221e8f2 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:44.999643 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-b1eb501f-b2c0-4aee-8f63-ed31c221e8f2 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:45.001161 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-b1eb501f-b2c0-4aee-8f63-ed31c221e8f2 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:45.002337 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-b1eb501f-b2c0-4aee-8f63-ed31c221e8f2 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1406 microversion: 2.20 time: 0.344097 May 04 19:10:45.009536 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 318/626] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:10:44 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1406 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 04 19:10:45.566539 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-02cc662e-bdf6-4592-9df5-584e254a0393 req-32c35ae6-13a8-4006-b383-454931e64f8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc9f6260-f308-4f45-809e-40f50eeb47d6", "name": "network-vif-plugged", "status": "completed", "tag": "7d596d4a-07a6-43a1-bc43-abfd6db7c370"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:10:45.578895 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-02cc662e-bdf6-4592-9df5-584e254a0393 req-32c35ae6-13a8-4006-b383-454931e64f8e service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:45.579732 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-02cc662e-bdf6-4592-9df5-584e254a0393 req-32c35ae6-13a8-4006-b383-454931e64f8e service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:45.592696 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-02cc662e-bdf6-4592-9df5-584e254a0393 req-32c35ae6-13a8-4006-b383-454931e64f8e service nova] Creating event network-vif-plugged:7d596d4a-07a6-43a1-bc43-abfd6db7c370 for instance bc9f6260-f308-4f45-809e-40f50eeb47d6 on hv-cinder-83090 May 04 19:10:45.597718 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-02cc662e-bdf6-4592-9df5-584e254a0393 req-32c35ae6-13a8-4006-b383-454931e64f8e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034713 May 04 19:10:45.598838 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 309/627] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:10:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:10:45.780198 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-4b1f326c-292d-45e2-a9ad-5a39a710e22f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:45.780971 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-4b1f326c-292d-45e2-a9ad-5a39a710e22f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:45.796763 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4b1f326c-292d-45e2-a9ad-5a39a710e22f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:45.797267 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4b1f326c-292d-45e2-a9ad-5a39a710e22f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:45.798814 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4b1f326c-292d-45e2-a9ad-5a39a710e22f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:45.799335 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4b1f326c-292d-45e2-a9ad-5a39a710e22f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:45.993375 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-d83608ae-fa90-4d6b-b021-9a600d2978d3 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:45.994859 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-d83608ae-fa90-4d6b-b021-9a600d2978d3 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 81874ac9-ec8c-4fb1-bd75-762920f7042d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:46.002858 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d83608ae-fa90-4d6b-b021-9a600d2978d3 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:46.003310 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d83608ae-fa90-4d6b-b021-9a600d2978d3 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:46.004267 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d83608ae-fa90-4d6b-b021-9a600d2978d3 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:46.004709 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d83608ae-fa90-4d6b-b021-9a600d2978d3 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:46.148062 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-4b1f326c-292d-45e2-a9ad-5a39a710e22f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:46.157273 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-4b1f326c-292d-45e2-a9ad-5a39a710e22f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 200 len: 1735 microversion: 2.1 time: 0.384831 May 04 19:10:46.158667 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 319/628] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:45 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 1735 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:10:46.164303 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-7c8210d2-a9f1-41c0-921c-cc410d69da72 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:46.165252 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-7c8210d2-a9f1-41c0-921c-cc410d69da72 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:46.172794 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7c8210d2-a9f1-41c0-921c-cc410d69da72 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:46.173618 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7c8210d2-a9f1-41c0-921c-cc410d69da72 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:46.174779 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7c8210d2-a9f1-41c0-921c-cc410d69da72 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:46.175459 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7c8210d2-a9f1-41c0-921c-cc410d69da72 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:46.400345 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-7c8210d2-a9f1-41c0-921c-cc410d69da72 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:46.409917 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-7c8210d2-a9f1-41c0-921c-cc410d69da72 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:46.411418 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-7c8210d2-a9f1-41c0-921c-cc410d69da72 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:46.413091 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-7c8210d2-a9f1-41c0-921c-cc410d69da72 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1406 microversion: 2.20 time: 0.252583 May 04 19:10:46.423201 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 320/629] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:10:46 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1406 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:10:46.493223 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-d83608ae-fa90-4d6b-b021-9a600d2978d3 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:46.501081 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-d83608ae-fa90-4d6b-b021-9a600d2978d3 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/81874ac9-ec8c-4fb1-bd75-762920f7042d" status: 200 len: 1367 microversion: 2.1 time: 0.520445 May 04 19:10:46.501687 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 310/630] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:45 2022] GET /compute/v2.1/servers/81874ac9-ec8c-4fb1-bd75-762920f7042d => generated 1367 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:10:47.048938 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-1e5ef195-4544-419e-82ca-e082d7443c56 req-a4ffc4ac-2684-434b-bc23-d5c85e2e2434 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81874ac9-ec8c-4fb1-bd75-762920f7042d", "tag": "1087fa4e-a377-4af8-a39c-8bc9ddffd2db"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:10:47.068636 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-1e5ef195-4544-419e-82ca-e082d7443c56 req-a4ffc4ac-2684-434b-bc23-d5c85e2e2434 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:47.069664 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-1e5ef195-4544-419e-82ca-e082d7443c56 req-a4ffc4ac-2684-434b-bc23-d5c85e2e2434 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:47.086898 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-1e5ef195-4544-419e-82ca-e082d7443c56 req-a4ffc4ac-2684-434b-bc23-d5c85e2e2434 service nova] Creating event network-changed:1087fa4e-a377-4af8-a39c-8bc9ddffd2db for instance 81874ac9-ec8c-4fb1-bd75-762920f7042d on hv-cinder-83090 May 04 19:10:47.092342 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-1e5ef195-4544-419e-82ca-e082d7443c56 req-a4ffc4ac-2684-434b-bc23-d5c85e2e2434 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047187 May 04 19:10:47.093615 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 321/631] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:10:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:10:47.177176 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-cfed1564-0611-47ba-9ed6-5b5ac737e1ca tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:47.178624 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-cfed1564-0611-47ba-9ed6-5b5ac737e1ca tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:47.187806 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cfed1564-0611-47ba-9ed6-5b5ac737e1ca tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:47.188716 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cfed1564-0611-47ba-9ed6-5b5ac737e1ca tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:47.189858 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cfed1564-0611-47ba-9ed6-5b5ac737e1ca tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:47.191093 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cfed1564-0611-47ba-9ed6-5b5ac737e1ca tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:47.417242 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-cfed1564-0611-47ba-9ed6-5b5ac737e1ca tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:47.425341 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-cfed1564-0611-47ba-9ed6-5b5ac737e1ca tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 200 len: 1735 microversion: 2.1 time: 0.253522 May 04 19:10:47.426057 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 311/632] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:47 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 1735 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:10:47.441580 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-d3c2539d-4b6a-42e6-9834-99a1d97a9492 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:47.442599 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-d3c2539d-4b6a-42e6-9834-99a1d97a9492 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:47.449432 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d3c2539d-4b6a-42e6-9834-99a1d97a9492 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:47.450000 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d3c2539d-4b6a-42e6-9834-99a1d97a9492 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:47.450881 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d3c2539d-4b6a-42e6-9834-99a1d97a9492 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:47.451395 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d3c2539d-4b6a-42e6-9834-99a1d97a9492 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:47.525589 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-2c8c0fa5-b7eb-4830-b586-10304201b3c5 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:47.526417 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-2c8c0fa5-b7eb-4830-b586-10304201b3c5 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 81874ac9-ec8c-4fb1-bd75-762920f7042d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:47.552952 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2c8c0fa5-b7eb-4830-b586-10304201b3c5 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:47.554281 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2c8c0fa5-b7eb-4830-b586-10304201b3c5 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:47.560325 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2c8c0fa5-b7eb-4830-b586-10304201b3c5 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:47.562296 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2c8c0fa5-b7eb-4830-b586-10304201b3c5 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:47.624138 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-d3c2539d-4b6a-42e6-9834-99a1d97a9492 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:47.634372 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-d3c2539d-4b6a-42e6-9834-99a1d97a9492 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:47.636314 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-d3c2539d-4b6a-42e6-9834-99a1d97a9492 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:47.638798 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-d3c2539d-4b6a-42e6-9834-99a1d97a9492 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1406 microversion: 2.20 time: 0.201784 May 04 19:10:47.640078 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 322/633] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:10:47 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1406 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:10:47.885646 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-2c8c0fa5-b7eb-4830-b586-10304201b3c5 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:47.893939 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-2c8c0fa5-b7eb-4830-b586-10304201b3c5 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/81874ac9-ec8c-4fb1-bd75-762920f7042d" status: 200 len: 1367 microversion: 2.1 time: 0.377822 May 04 19:10:47.905626 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 312/634] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:47 2022] GET /compute/v2.1/servers/81874ac9-ec8c-4fb1-bd75-762920f7042d => generated 1367 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:10:48.447330 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-6b0c27a7-70b6-48c4-9c7d-9df19fac14a8 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:48.448055 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-6b0c27a7-70b6-48c4-9c7d-9df19fac14a8 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:48.455782 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6b0c27a7-70b6-48c4-9c7d-9df19fac14a8 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:48.456294 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6b0c27a7-70b6-48c4-9c7d-9df19fac14a8 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:48.457177 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6b0c27a7-70b6-48c4-9c7d-9df19fac14a8 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:48.457714 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6b0c27a7-70b6-48c4-9c7d-9df19fac14a8 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:48.640241 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-6b0c27a7-70b6-48c4-9c7d-9df19fac14a8 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:48.651038 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-6b0c27a7-70b6-48c4-9c7d-9df19fac14a8 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 200 len: 1735 microversion: 2.1 time: 0.211493 May 04 19:10:48.651620 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 323/635] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:48 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 1735 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:10:48.657092 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-b18bc641-2e24-4a9d-a9d1-ffac69a2663d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:48.658368 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-b18bc641-2e24-4a9d-a9d1-ffac69a2663d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:48.665051 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b18bc641-2e24-4a9d-a9d1-ffac69a2663d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:48.665543 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b18bc641-2e24-4a9d-a9d1-ffac69a2663d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:48.666480 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b18bc641-2e24-4a9d-a9d1-ffac69a2663d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:48.667104 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b18bc641-2e24-4a9d-a9d1-ffac69a2663d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:48.821107 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-b18bc641-2e24-4a9d-a9d1-ffac69a2663d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:48.831166 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-b18bc641-2e24-4a9d-a9d1-ffac69a2663d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:48.833337 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-b18bc641-2e24-4a9d-a9d1-ffac69a2663d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:48.834877 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-b18bc641-2e24-4a9d-a9d1-ffac69a2663d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1599 microversion: 2.20 time: 0.181633 May 04 19:10:48.835967 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 313/636] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:10:48 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1599 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:10:48.853182 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-42806ee1-cbb6-4214-8827-133282d71bab tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:48.853709 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-42806ee1-cbb6-4214-8827-133282d71bab tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:48.859829 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-42806ee1-cbb6-4214-8827-133282d71bab tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:48.860535 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-42806ee1-cbb6-4214-8827-133282d71bab tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:48.861498 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-42806ee1-cbb6-4214-8827-133282d71bab tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:48.862205 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-42806ee1-cbb6-4214-8827-133282d71bab tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:48.915728 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-fe81ce6b-fff8-42fc-8be8-d5f1f039c1c2 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:48.916767 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-fe81ce6b-fff8-42fc-8be8-d5f1f039c1c2 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 81874ac9-ec8c-4fb1-bd75-762920f7042d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:48.927150 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-fe81ce6b-fff8-42fc-8be8-d5f1f039c1c2 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:48.929390 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-fe81ce6b-fff8-42fc-8be8-d5f1f039c1c2 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:48.931369 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-fe81ce6b-fff8-42fc-8be8-d5f1f039c1c2 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:48.936323 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-fe81ce6b-fff8-42fc-8be8-d5f1f039c1c2 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:48.980512 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-42806ee1-cbb6-4214-8827-133282d71bab tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.131487 May 04 19:10:48.981767 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 324/637] 10.222.0.69 () {60 vars in 1315 bytes} [Wed May 4 19:10:48 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6/os-interface => generated 285 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 04 19:10:48.986731 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-d31ae0a7-d78f-411d-8791-2ce24b1a8d22 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:48.987934 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-d31ae0a7-d78f-411d-8791-2ce24b1a8d22 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:48.999623 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d31ae0a7-d78f-411d-8791-2ce24b1a8d22 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:49.007183 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d31ae0a7-d78f-411d-8791-2ce24b1a8d22 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:49.008387 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d31ae0a7-d78f-411d-8791-2ce24b1a8d22 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:49.009048 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d31ae0a7-d78f-411d-8791-2ce24b1a8d22 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:49.049706 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-d31ae0a7-d78f-411d-8791-2ce24b1a8d22 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062324 May 04 19:10:49.050988 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 325/638] 10.222.0.69 () {58 vars in 1301 bytes} [Wed May 4 19:10:48 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 04 19:10:49.152798 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-e92f22cf-a488-41df-be2a-027bee655010 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:49.153631 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-e92f22cf-a488-41df-be2a-027bee655010 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:49.160433 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e92f22cf-a488-41df-be2a-027bee655010 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:49.160813 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-fe81ce6b-fff8-42fc-8be8-d5f1f039c1c2 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:49.161425 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e92f22cf-a488-41df-be2a-027bee655010 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:49.162970 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e92f22cf-a488-41df-be2a-027bee655010 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:49.163613 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e92f22cf-a488-41df-be2a-027bee655010 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:49.170926 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-fe81ce6b-fff8-42fc-8be8-d5f1f039c1c2 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/81874ac9-ec8c-4fb1-bd75-762920f7042d" status: 200 len: 1367 microversion: 2.1 time: 0.260219 May 04 19:10:49.174149 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 314/639] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:48 2022] GET /compute/v2.1/servers/81874ac9-ec8c-4fb1-bd75-762920f7042d => generated 1367 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:10:49.197277 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-e92f22cf-a488-41df-be2a-027bee655010 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Going to try to terminate instance {{(pid=117124) delete /opt/stack/nova/nova/compute/api.py:2664}} May 04 19:10:49.301628 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-e92f22cf-a488-41df-be2a-027bee655010 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "DELETE /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 204 len: 0 microversion: 2.1 time: 0.152085 May 04 19:10:49.302694 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 326/640] 10.222.0.69 () {58 vars in 1238 bytes} [Wed May 4 19:10:49 2022] DELETE /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 04 19:10:49.311722 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-e403f15d-38e4-4db8-8852-94e85702e0b2 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:49.312338 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-e403f15d-38e4-4db8-8852-94e85702e0b2 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:49.319819 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e403f15d-38e4-4db8-8852-94e85702e0b2 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:49.320275 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e403f15d-38e4-4db8-8852-94e85702e0b2 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:49.321059 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e403f15d-38e4-4db8-8852-94e85702e0b2 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:49.321513 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e403f15d-38e4-4db8-8852-94e85702e0b2 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:49.500943 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-e403f15d-38e4-4db8-8852-94e85702e0b2 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:49.509832 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-e403f15d-38e4-4db8-8852-94e85702e0b2 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1671 microversion: 2.1 time: 0.202162 May 04 19:10:49.510803 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 315/641] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:49 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1671 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:10:49.669310 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-c1464956-4d79-4288-a05c-8d01e663a998 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:49.670044 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-c1464956-4d79-4288-a05c-8d01e663a998 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:49.676767 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c1464956-4d79-4288-a05c-8d01e663a998 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:49.677198 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c1464956-4d79-4288-a05c-8d01e663a998 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:49.678069 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c1464956-4d79-4288-a05c-8d01e663a998 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:49.678682 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c1464956-4d79-4288-a05c-8d01e663a998 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:50.167000 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-c1464956-4d79-4288-a05c-8d01e663a998 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:50.180299 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-c1464956-4d79-4288-a05c-8d01e663a998 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 200 len: 1735 microversion: 2.1 time: 0.515047 May 04 19:10:50.182957 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 327/642] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:49 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 1735 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:10:50.188522 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-e35d4bd4-eb08-4dd8-b4c0-422db28049a1 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:50.191637 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-e35d4bd4-eb08-4dd8-b4c0-422db28049a1 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 81874ac9-ec8c-4fb1-bd75-762920f7042d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:50.204496 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e35d4bd4-eb08-4dd8-b4c0-422db28049a1 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:50.204968 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e35d4bd4-eb08-4dd8-b4c0-422db28049a1 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:50.205807 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e35d4bd4-eb08-4dd8-b4c0-422db28049a1 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:50.206244 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e35d4bd4-eb08-4dd8-b4c0-422db28049a1 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:50.530148 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-317f75d9-b64b-45c8-92f9-496dd25c143b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:50.531190 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-317f75d9-b64b-45c8-92f9-496dd25c143b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:50.539062 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-317f75d9-b64b-45c8-92f9-496dd25c143b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:50.540920 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-317f75d9-b64b-45c8-92f9-496dd25c143b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:50.542591 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-317f75d9-b64b-45c8-92f9-496dd25c143b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:50.543917 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-317f75d9-b64b-45c8-92f9-496dd25c143b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:50.765145 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-317f75d9-b64b-45c8-92f9-496dd25c143b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:50.774864 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-317f75d9-b64b-45c8-92f9-496dd25c143b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1671 microversion: 2.1 time: 0.250537 May 04 19:10:50.776303 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 328/643] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:50 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1671 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:10:50.791441 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-efa60745-2499-44f8-b6af-ac718a6bc21b req-29df9100-96c6-4128-91da-82e724343046 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc9f6260-f308-4f45-809e-40f50eeb47d6", "tag": "7d596d4a-07a6-43a1-bc43-abfd6db7c370"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:10:50.800841 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-efa60745-2499-44f8-b6af-ac718a6bc21b req-29df9100-96c6-4128-91da-82e724343046 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:50.801627 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-efa60745-2499-44f8-b6af-ac718a6bc21b req-29df9100-96c6-4128-91da-82e724343046 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:50.815691 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-efa60745-2499-44f8-b6af-ac718a6bc21b req-29df9100-96c6-4128-91da-82e724343046 service nova] Creating event network-changed:7d596d4a-07a6-43a1-bc43-abfd6db7c370 for instance bc9f6260-f308-4f45-809e-40f50eeb47d6 on hv-cinder-83090 May 04 19:10:50.821273 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-efa60745-2499-44f8-b6af-ac718a6bc21b req-29df9100-96c6-4128-91da-82e724343046 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043640 May 04 19:10:50.825705 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 329/644] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:10:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:10:50.853787 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-e35d4bd4-eb08-4dd8-b4c0-422db28049a1 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:50.866761 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-e35d4bd4-eb08-4dd8-b4c0-422db28049a1 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/81874ac9-ec8c-4fb1-bd75-762920f7042d" status: 200 len: 1367 microversion: 2.1 time: 0.680185 May 04 19:10:50.868825 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 316/645] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:50 2022] GET /compute/v2.1/servers/81874ac9-ec8c-4fb1-bd75-762920f7042d => generated 1367 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:10:51.204013 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-a4f1d7d2-5c2d-42c6-b8c4-deed84aef09f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:51.205164 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-a4f1d7d2-5c2d-42c6-b8c4-deed84aef09f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:51.216312 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a4f1d7d2-5c2d-42c6-b8c4-deed84aef09f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:51.218076 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a4f1d7d2-5c2d-42c6-b8c4-deed84aef09f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:51.219362 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a4f1d7d2-5c2d-42c6-b8c4-deed84aef09f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:51.220209 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a4f1d7d2-5c2d-42c6-b8c4-deed84aef09f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:51.538902 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-a4f1d7d2-5c2d-42c6-b8c4-deed84aef09f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:51.552249 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-a4f1d7d2-5c2d-42c6-b8c4-deed84aef09f tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 200 len: 1735 microversion: 2.1 time: 0.355259 May 04 19:10:51.555156 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 330/646] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:51 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 1735 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:10:51.793359 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-53b71937-3e26-4c38-884d-e4250aa5f2d0 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:51.793866 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-53b71937-3e26-4c38-884d-e4250aa5f2d0 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:51.812784 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-53b71937-3e26-4c38-884d-e4250aa5f2d0 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:51.813546 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-53b71937-3e26-4c38-884d-e4250aa5f2d0 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:51.814498 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-53b71937-3e26-4c38-884d-e4250aa5f2d0 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:51.815086 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-53b71937-3e26-4c38-884d-e4250aa5f2d0 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:51.883967 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-24c72813-d2e9-4c6e-81d6-fa411d59d2ac tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:51.885416 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-24c72813-d2e9-4c6e-81d6-fa411d59d2ac tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 81874ac9-ec8c-4fb1-bd75-762920f7042d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:51.913372 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-24c72813-d2e9-4c6e-81d6-fa411d59d2ac tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:51.914089 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-24c72813-d2e9-4c6e-81d6-fa411d59d2ac tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:51.918244 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-24c72813-d2e9-4c6e-81d6-fa411d59d2ac tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:51.918892 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-24c72813-d2e9-4c6e-81d6-fa411d59d2ac tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:52.337373 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-53b71937-3e26-4c38-884d-e4250aa5f2d0 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:52.348201 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-53b71937-3e26-4c38-884d-e4250aa5f2d0 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1671 microversion: 2.1 time: 0.558533 May 04 19:10:52.363085 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 317/647] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:51 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1671 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:10:52.382461 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-24c72813-d2e9-4c6e-81d6-fa411d59d2ac tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:52.390193 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-24c72813-d2e9-4c6e-81d6-fa411d59d2ac tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/81874ac9-ec8c-4fb1-bd75-762920f7042d" status: 200 len: 1367 microversion: 2.1 time: 0.511101 May 04 19:10:52.393887 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 331/648] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:51 2022] GET /compute/v2.1/servers/81874ac9-ec8c-4fb1-bd75-762920f7042d => generated 1367 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:10:52.572243 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-38635538-9dc0-48a4-a2b8-6ce6ff0aafbc tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:52.573532 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-38635538-9dc0-48a4-a2b8-6ce6ff0aafbc tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:52.587028 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-38635538-9dc0-48a4-a2b8-6ce6ff0aafbc tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:52.587517 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-38635538-9dc0-48a4-a2b8-6ce6ff0aafbc tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:52.588339 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-38635538-9dc0-48a4-a2b8-6ce6ff0aafbc tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:52.588787 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-38635538-9dc0-48a4-a2b8-6ce6ff0aafbc tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:52.898750 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-38635538-9dc0-48a4-a2b8-6ce6ff0aafbc tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:52.907440 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-38635538-9dc0-48a4-a2b8-6ce6ff0aafbc tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 200 len: 1735 microversion: 2.1 time: 0.339078 May 04 19:10:52.908715 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 318/649] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:52 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 1735 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:10:53.368190 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-3062e9d5-27d7-49de-ba82-814c9be6d318 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:53.369004 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-3062e9d5-27d7-49de-ba82-814c9be6d318 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:53.376132 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3062e9d5-27d7-49de-ba82-814c9be6d318 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:53.376964 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3062e9d5-27d7-49de-ba82-814c9be6d318 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:53.378071 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3062e9d5-27d7-49de-ba82-814c9be6d318 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:53.378759 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3062e9d5-27d7-49de-ba82-814c9be6d318 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:53.411012 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-893fa198-cd19-4684-9a31-d3fb83f12bf9 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:53.412365 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-893fa198-cd19-4684-9a31-d3fb83f12bf9 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 81874ac9-ec8c-4fb1-bd75-762920f7042d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:53.421638 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-893fa198-cd19-4684-9a31-d3fb83f12bf9 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:53.424169 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-893fa198-cd19-4684-9a31-d3fb83f12bf9 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:53.434624 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-893fa198-cd19-4684-9a31-d3fb83f12bf9 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:53.435590 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-893fa198-cd19-4684-9a31-d3fb83f12bf9 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:53.481256 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-3062e9d5-27d7-49de-ba82-814c9be6d318 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:53.492038 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-3062e9d5-27d7-49de-ba82-814c9be6d318 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1604 microversion: 2.1 time: 0.128304 May 04 19:10:53.492977 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 332/650] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:53 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1604 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:10:53.839129 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-893fa198-cd19-4684-9a31-d3fb83f12bf9 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:53.850311 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-893fa198-cd19-4684-9a31-d3fb83f12bf9 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/81874ac9-ec8c-4fb1-bd75-762920f7042d" status: 200 len: 1367 microversion: 2.1 time: 0.440375 May 04 19:10:53.851022 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 319/651] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:53 2022] GET /compute/v2.1/servers/81874ac9-ec8c-4fb1-bd75-762920f7042d => generated 1367 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:10:53.924250 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-b773356b-43b2-45bc-b284-28a13fe2b636 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:53.925242 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-b773356b-43b2-45bc-b284-28a13fe2b636 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:53.933563 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b773356b-43b2-45bc-b284-28a13fe2b636 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:53.936462 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b773356b-43b2-45bc-b284-28a13fe2b636 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:53.937673 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b773356b-43b2-45bc-b284-28a13fe2b636 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:53.938351 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b773356b-43b2-45bc-b284-28a13fe2b636 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:54.185210 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-cd84d449-fd82-441f-898b-c0e4e9b5612b req-7032e77d-f8ab-4cde-b4b3-8decf669bee0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d", "name": "network-vif-deleted", "tag": "f2a67d60-fe59-49da-83ac-a36d263ffa54"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:10:54.202951 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-cd84d449-fd82-441f-898b-c0e4e9b5612b req-7032e77d-f8ab-4cde-b4b3-8decf669bee0 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:54.203619 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-cd84d449-fd82-441f-898b-c0e4e9b5612b req-7032e77d-f8ab-4cde-b4b3-8decf669bee0 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:54.234201 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-cd84d449-fd82-441f-898b-c0e4e9b5612b req-7032e77d-f8ab-4cde-b4b3-8decf669bee0 service nova] Creating event network-vif-deleted:f2a67d60-fe59-49da-83ac-a36d263ffa54 for instance f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d on hv-cinder-83090 May 04 19:10:54.241699 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-cd84d449-fd82-441f-898b-c0e4e9b5612b req-7032e77d-f8ab-4cde-b4b3-8decf669bee0 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059339 May 04 19:10:54.242954 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 320/652] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 04 19:10:54.257604 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-b773356b-43b2-45bc-b284-28a13fe2b636 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:54.267197 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-b773356b-43b2-45bc-b284-28a13fe2b636 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 200 len: 1735 microversion: 2.1 time: 0.346530 May 04 19:10:54.268427 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 333/653] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:53 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 1735 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:10:54.511382 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-819659a0-dcbd-45a8-8d8d-f9226026601b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:54.512125 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-819659a0-dcbd-45a8-8d8d-f9226026601b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:54.524191 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-819659a0-dcbd-45a8-8d8d-f9226026601b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:54.524652 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-819659a0-dcbd-45a8-8d8d-f9226026601b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:54.525428 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-819659a0-dcbd-45a8-8d8d-f9226026601b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:54.525888 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-819659a0-dcbd-45a8-8d8d-f9226026601b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:54.563955 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-b892d4c6-5255-4d63-9667-12c5f8aab6e3 req-1bced00e-a097-496f-a112-b7cc5f49d8c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81874ac9-ec8c-4fb1-bd75-762920f7042d", "name": "network-vif-plugged", "status": "completed", "tag": "1087fa4e-a377-4af8-a39c-8bc9ddffd2db"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:10:54.576342 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-b892d4c6-5255-4d63-9667-12c5f8aab6e3 req-1bced00e-a097-496f-a112-b7cc5f49d8c0 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:54.576786 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-b892d4c6-5255-4d63-9667-12c5f8aab6e3 req-1bced00e-a097-496f-a112-b7cc5f49d8c0 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:54.583394 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-819659a0-dcbd-45a8-8d8d-f9226026601b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:54.584127 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-819659a0-dcbd-45a8-8d8d-f9226026601b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:54.584762 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.objects.instance [None req-819659a0-dcbd-45a8-8d8d-f9226026601b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lazy-loading 'fault' on Instance uuid f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d {{(pid=117125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 04 19:10:54.599382 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-b892d4c6-5255-4d63-9667-12c5f8aab6e3 req-1bced00e-a097-496f-a112-b7cc5f49d8c0 service nova] Creating event network-vif-plugged:1087fa4e-a377-4af8-a39c-8bc9ddffd2db for instance 81874ac9-ec8c-4fb1-bd75-762920f7042d on hv-cinder-83090 May 04 19:10:54.612417 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-b892d4c6-5255-4d63-9667-12c5f8aab6e3 req-1bced00e-a097-496f-a112-b7cc5f49d8c0 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054021 May 04 19:10:54.619468 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 334/654] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 04 19:10:54.664495 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-819659a0-dcbd-45a8-8d8d-f9226026601b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:54.695217 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-819659a0-dcbd-45a8-8d8d-f9226026601b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 200 len: 1326 microversion: 2.1 time: 0.190058 May 04 19:10:54.696817 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 321/655] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:54 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 1326 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:10:54.868204 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-c2d44b55-c622-4b5e-9705-c768acee231c tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:54.869214 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-c2d44b55-c622-4b5e-9705-c768acee231c tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 81874ac9-ec8c-4fb1-bd75-762920f7042d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:54.881179 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c2d44b55-c622-4b5e-9705-c768acee231c tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:54.882098 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c2d44b55-c622-4b5e-9705-c768acee231c tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:54.883649 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c2d44b55-c622-4b5e-9705-c768acee231c tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:54.889021 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c2d44b55-c622-4b5e-9705-c768acee231c tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:55.145787 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-c2d44b55-c622-4b5e-9705-c768acee231c tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:55.163430 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-c2d44b55-c622-4b5e-9705-c768acee231c tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/81874ac9-ec8c-4fb1-bd75-762920f7042d" status: 200 len: 1367 microversion: 2.1 time: 0.299572 May 04 19:10:55.174692 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 335/656] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:54 2022] GET /compute/v2.1/servers/81874ac9-ec8c-4fb1-bd75-762920f7042d => generated 1367 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:10:55.287732 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-2d009c25-018f-4816-8c11-cc1642ab1865 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:55.290135 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-2d009c25-018f-4816-8c11-cc1642ab1865 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:55.298586 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2d009c25-018f-4816-8c11-cc1642ab1865 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:55.301288 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2d009c25-018f-4816-8c11-cc1642ab1865 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:55.302302 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2d009c25-018f-4816-8c11-cc1642ab1865 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:55.302986 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2d009c25-018f-4816-8c11-cc1642ab1865 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:55.588578 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-2d009c25-018f-4816-8c11-cc1642ab1865 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:55.603749 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-2d009c25-018f-4816-8c11-cc1642ab1865 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 200 len: 1735 microversion: 2.1 time: 0.319227 May 04 19:10:55.605523 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 322/657] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:55 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 1735 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:10:55.712942 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-14c07b32-3769-46f3-8a5b-9b00b9ca6855 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:55.713629 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-14c07b32-3769-46f3-8a5b-9b00b9ca6855 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:55.723884 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-14c07b32-3769-46f3-8a5b-9b00b9ca6855 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:55.724342 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-14c07b32-3769-46f3-8a5b-9b00b9ca6855 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:55.725742 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-14c07b32-3769-46f3-8a5b-9b00b9ca6855 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:55.726182 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-14c07b32-3769-46f3-8a5b-9b00b9ca6855 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:55.763422 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.wsgi [None req-14c07b32-3769-46f3-8a5b-9b00b9ca6855 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] HTTP exception thrown: Instance f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d could not be found. May 04 19:10:55.764041 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-14c07b32-3769-46f3-8a5b-9b00b9ca6855 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Returning 404 to user: Instance f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d could not be found. {{(pid=117124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 04 19:10:55.764894 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-14c07b32-3769-46f3-8a5b-9b00b9ca6855 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 404 len: 111 microversion: 2.1 time: 0.056491 May 04 19:10:55.768842 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 336/658] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:55 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 04 19:10:55.778813 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-b92d6d95-4621-432c-95d2-3e38fdfc393c tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '.version_select at 0x7fc3f611b9d0>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:55.821009 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-b92d6d95-4621-432c-95d2-3e38fdfc393c tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-894996204" status: 202 len: 0 microversion: 2.1 time: 0.044240 May 04 19:10:55.825257 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 323/659] 10.222.0.69 () {58 vars in 1217 bytes} [Wed May 4 19:10:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-894996204 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 04 19:10:56.184287 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-f1af719b-ce1b-4f4f-958d-a89ce0157d46 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:56.184887 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-f1af719b-ce1b-4f4f-958d-a89ce0157d46 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 81874ac9-ec8c-4fb1-bd75-762920f7042d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:56.195916 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f1af719b-ce1b-4f4f-958d-a89ce0157d46 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:56.196659 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f1af719b-ce1b-4f4f-958d-a89ce0157d46 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:56.201144 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f1af719b-ce1b-4f4f-958d-a89ce0157d46 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:56.201903 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f1af719b-ce1b-4f4f-958d-a89ce0157d46 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:56.384106 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-f1af719b-ce1b-4f4f-958d-a89ce0157d46 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:56.396836 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-f1af719b-ce1b-4f4f-958d-a89ce0157d46 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/81874ac9-ec8c-4fb1-bd75-762920f7042d" status: 200 len: 1367 microversion: 2.1 time: 0.220207 May 04 19:10:56.410383 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 337/660] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:56 2022] GET /compute/v2.1/servers/81874ac9-ec8c-4fb1-bd75-762920f7042d => generated 1367 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:10:56.622904 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-4404d392-4fb0-4ff0-a4f5-0b93e24afbd7 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:56.623804 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-4404d392-4fb0-4ff0-a4f5-0b93e24afbd7 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:56.635540 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4404d392-4fb0-4ff0-a4f5-0b93e24afbd7 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:56.636214 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4404d392-4fb0-4ff0-a4f5-0b93e24afbd7 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:56.637053 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4404d392-4fb0-4ff0-a4f5-0b93e24afbd7 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:56.639307 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4404d392-4fb0-4ff0-a4f5-0b93e24afbd7 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:56.819542 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-4404d392-4fb0-4ff0-a4f5-0b93e24afbd7 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:56.827251 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-4404d392-4fb0-4ff0-a4f5-0b93e24afbd7 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 200 len: 1735 microversion: 2.1 time: 0.208709 May 04 19:10:56.827810 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 338/661] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:56 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 1735 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:10:56.832180 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-04409512-1162-4208-a189-d8ce935750b4 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Action: 'create', calling method: .version_select at 0x7fc3f6145d30>, body: {"keypair": {"name": "tempest-keypair-1700834279"}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:10:56.850854 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-04409512-1162-4208-a189-d8ce935750b4 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Getting quotas for project df8f18c943e24a3ab621f08fa24c596b. Resources: {'key_pairs'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 04 19:10:56.851424 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-76276348-9fb7-4b88-b0d4-7afd711ec609 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Action: 'create', calling method: .version_select at 0x7fc3f61b74c0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-630419074"}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:10:56.855367 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-04409512-1162-4208-a189-d8ce935750b4 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Getting quotas for user d54ad9809c8241a18d88fa6cd960badd and project df8f18c943e24a3ab621f08fa24c596b. Resources: {'key_pairs'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 04 19:10:56.866054 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-76276348-9fb7-4b88-b0d4-7afd711ec609 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Getting quotas for project 157e9c40125e42b4b5a908fc58bfa939. Resources: {'key_pairs'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 04 19:10:56.870431 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-76276348-9fb7-4b88-b0d4-7afd711ec609 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Getting quotas for user 3c8b295066bc4ae695f6e60b9b3dc5dd and project 157e9c40125e42b4b5a908fc58bfa939. Resources: {'key_pairs'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 04 19:10:56.991660 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-04409512-1162-4208-a189-d8ce935750b4 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Getting quotas for project df8f18c943e24a3ab621f08fa24c596b. Resources: {'key_pairs'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 04 19:10:56.995630 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-04409512-1162-4208-a189-d8ce935750b4 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Getting quotas for user d54ad9809c8241a18d88fa6cd960badd and project df8f18c943e24a3ab621f08fa24c596b. Resources: {'key_pairs'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 04 19:10:57.009447 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-04409512-1162-4208-a189-d8ce935750b4 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.180461 May 04 19:10:57.010873 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 339/662] 10.222.0.69 () {60 vars in 1157 bytes} [Wed May 4 19:10:56 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:10:57.123169 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-76276348-9fb7-4b88-b0d4-7afd711ec609 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Getting quotas for project 157e9c40125e42b4b5a908fc58bfa939. Resources: {'key_pairs'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 04 19:10:57.126917 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-76276348-9fb7-4b88-b0d4-7afd711ec609 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Getting quotas for user 3c8b295066bc4ae695f6e60b9b3dc5dd and project 157e9c40125e42b4b5a908fc58bfa939. Resources: {'key_pairs'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 04 19:10:57.142253 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-76276348-9fb7-4b88-b0d4-7afd711ec609 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 2314 microversion: 2.1 time: 0.556697 May 04 19:10:57.143047 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 324/663] 10.222.0.69 () {60 vars in 1157 bytes} [Wed May 4 19:10:56 2022] POST /compute/v2.1/os-keypairs => generated 2314 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:10:57.417751 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-ea9b59e1-13b2-4fd6-8179-6b8933b428dd tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:57.418605 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-ea9b59e1-13b2-4fd6-8179-6b8933b428dd tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 81874ac9-ec8c-4fb1-bd75-762920f7042d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:57.426385 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ea9b59e1-13b2-4fd6-8179-6b8933b428dd tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:57.427021 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ea9b59e1-13b2-4fd6-8179-6b8933b428dd tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:57.428013 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ea9b59e1-13b2-4fd6-8179-6b8933b428dd tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:57.428708 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ea9b59e1-13b2-4fd6-8179-6b8933b428dd tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:57.653108 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-ea9b59e1-13b2-4fd6-8179-6b8933b428dd tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:57.663259 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-ea9b59e1-13b2-4fd6-8179-6b8933b428dd tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/81874ac9-ec8c-4fb1-bd75-762920f7042d" status: 200 len: 1557 microversion: 2.1 time: 0.250616 May 04 19:10:57.674265 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 340/664] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:57 2022] GET /compute/v2.1/servers/81874ac9-ec8c-4fb1-bd75-762920f7042d => generated 1557 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:10:57.679977 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-25a74732-c87e-4f50-8cec-e8a918f202a5 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:57.680470 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-25a74732-c87e-4f50-8cec-e8a918f202a5 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 81874ac9-ec8c-4fb1-bd75-762920f7042d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:57.686414 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-25a74732-c87e-4f50-8cec-e8a918f202a5 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:57.687053 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-25a74732-c87e-4f50-8cec-e8a918f202a5 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:57.687822 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-25a74732-c87e-4f50-8cec-e8a918f202a5 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:57.688247 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-25a74732-c87e-4f50-8cec-e8a918f202a5 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:57.794495 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-25a74732-c87e-4f50-8cec-e8a918f202a5 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/81874ac9-ec8c-4fb1-bd75-762920f7042d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.118769 May 04 19:10:57.795232 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 325/665] 10.222.0.69 () {58 vars in 1274 bytes} [Wed May 4 19:10:57 2022] GET /compute/v2.1/servers/81874ac9-ec8c-4fb1-bd75-762920f7042d/os-interface => generated 284 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:10:57.844176 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-38606d17-9aa4-453e-8b5e-873823e4b5b3 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:57.845375 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-38606d17-9aa4-453e-8b5e-873823e4b5b3 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:57.851579 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-38606d17-9aa4-453e-8b5e-873823e4b5b3 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:57.852232 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-38606d17-9aa4-453e-8b5e-873823e4b5b3 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:57.853348 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-38606d17-9aa4-453e-8b5e-873823e4b5b3 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:57.853973 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-38606d17-9aa4-453e-8b5e-873823e4b5b3 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:58.169289 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-38606d17-9aa4-453e-8b5e-873823e4b5b3 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:58.180796 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-38606d17-9aa4-453e-8b5e-873823e4b5b3 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 200 len: 1735 microversion: 2.1 time: 0.340072 May 04 19:10:58.191308 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 341/666] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:57 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 1735 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:10:58.529672 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-9ccf40d9-8957-448d-ac29-a94ebf8461e8 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1400429523", "imageRef": "2869595e-cda4-45af-aaeb-0779eb5f4114", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "10d3c238-2c90-40fe-8795-81f60cedf693"}], "security_groups": [{"name": "tempest-securitygroup--1538829598"}], "key_name": "tempest-keypair-1700834279", "user_data": "}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:10:58.664067 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.network.neutron [None req-9ccf40d9-8957-448d-ac29-a94ebf8461e8 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] validate_networks() for [('10d3c238-2c90-40fe-8795-81f60cedf693', None, None, None, None, None)] {{(pid=117125) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 04 19:10:59.200338 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-b95c3847-039b-4ff6-915b-35d7489404d2 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:59.201792 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-b95c3847-039b-4ff6-915b-35d7489404d2 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:59.210963 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b95c3847-039b-4ff6-915b-35d7489404d2 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:59.212127 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b95c3847-039b-4ff6-915b-35d7489404d2 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:59.213080 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b95c3847-039b-4ff6-915b-35d7489404d2 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:59.222333 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b95c3847-039b-4ff6-915b-35d7489404d2 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:59.488172 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-9ccf40d9-8957-448d-ac29-a94ebf8461e8 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Flavor limits 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 04 19:10:59.488682 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-9ccf40d9-8957-448d-ac29-a94ebf8461e8 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Image limits 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 04 19:10:59.489345 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-9ccf40d9-8957-448d-ac29-a94ebf8461e8 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Flavor pref 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 04 19:10:59.489864 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-9ccf40d9-8957-448d-ac29-a94ebf8461e8 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Image pref 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 04 19:10:59.490788 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-9ccf40d9-8957-448d-ac29-a94ebf8461e8 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 04 19:10:59.534630 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9ccf40d9-8957-448d-ac29-a94ebf8461e8 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:59.535787 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9ccf40d9-8957-448d-ac29-a94ebf8461e8 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:59.537390 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9ccf40d9-8957-448d-ac29-a94ebf8461e8 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:59.538145 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9ccf40d9-8957-448d-ac29-a94ebf8461e8 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:59.563131 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-9ccf40d9-8957-448d-ac29-a94ebf8461e8 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Getting quotas for project df8f18c943e24a3ab621f08fa24c596b. Resources: {'cores', 'ram', 'instances'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 04 19:10:59.574037 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-9ccf40d9-8957-448d-ac29-a94ebf8461e8 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Getting quotas for user d54ad9809c8241a18d88fa6cd960badd and project df8f18c943e24a3ab621f08fa24c596b. Resources: {'cores', 'ram', 'instances'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 04 19:10:59.597279 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-b95c3847-039b-4ff6-915b-35d7489404d2 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:59.598496 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-9ccf40d9-8957-448d-ac29-a94ebf8461e8 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Going to run 1 instances... {{(pid=117125) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 04 19:10:59.601708 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-9ccf40d9-8957-448d-ac29-a94ebf8461e8 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: c0ca0b46-570c-45ff-820a-87a4197033f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2869595e-cda4-45af-aaeb-0779eb5f4114',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 04 19:10:59.607194 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-b95c3847-039b-4ff6-915b-35d7489404d2 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 200 len: 1735 microversion: 2.1 time: 0.412074 May 04 19:10:59.607782 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 342/667] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:59 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 1735 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:10:59.641861 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-1a5aad74-e325-4c30-9409-90de2aaaa011 req-2f8b524c-ab4b-4b5b-b197-098ba2a59f03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81874ac9-ec8c-4fb1-bd75-762920f7042d", "tag": "1087fa4e-a377-4af8-a39c-8bc9ddffd2db"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:10:59.658875 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-1a5aad74-e325-4c30-9409-90de2aaaa011 req-2f8b524c-ab4b-4b5b-b197-098ba2a59f03 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:10:59.661680 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-1a5aad74-e325-4c30-9409-90de2aaaa011 req-2f8b524c-ab4b-4b5b-b197-098ba2a59f03 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:10:59.691114 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-1a5aad74-e325-4c30-9409-90de2aaaa011 req-2f8b524c-ab4b-4b5b-b197-098ba2a59f03 service nova] Creating event network-changed:1087fa4e-a377-4af8-a39c-8bc9ddffd2db for instance 81874ac9-ec8c-4fb1-bd75-762920f7042d on hv-cinder-83090 May 04 19:10:59.706307 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-1a5aad74-e325-4c30-9409-90de2aaaa011 req-2f8b524c-ab4b-4b5b-b197-098ba2a59f03 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060913 May 04 19:10:59.708774 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 343/668] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:10:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:10:59.734345 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-9ccf40d9-8957-448d-ac29-a94ebf8461e8 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.208882 May 04 19:10:59.745210 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 326/669] 10.222.0.69 () {60 vars in 1146 bytes} [Wed May 4 19:10:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 1220 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 04 19:10:59.751405 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-a7954226-e97c-4a11-a61a-808080e3531b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:10:59.753293 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-a7954226-e97c-4a11-a61a-808080e3531b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: c0ca0b46-570c-45ff-820a-87a4197033f3] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:10:59.840824 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-a7954226-e97c-4a11-a61a-808080e3531b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:10:59.848316 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-a7954226-e97c-4a11-a61a-808080e3531b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/c0ca0b46-570c-45ff-820a-87a4197033f3" status: 200 len: 1238 microversion: 2.1 time: 0.101108 May 04 19:10:59.851837 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 344/670] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:10:59 2022] GET /compute/v2.1/servers/c0ca0b46-570c-45ff-820a-87a4197033f3 => generated 1238 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:11:00.633838 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-c1d705dd-d498-4cc7-ba39-a261f14331bb tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:00.635196 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-c1d705dd-d498-4cc7-ba39-a261f14331bb tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:00.643035 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c1d705dd-d498-4cc7-ba39-a261f14331bb tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:00.643491 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c1d705dd-d498-4cc7-ba39-a261f14331bb tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:00.644456 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c1d705dd-d498-4cc7-ba39-a261f14331bb tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:00.650076 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c1d705dd-d498-4cc7-ba39-a261f14331bb tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:00.849146 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-c1d705dd-d498-4cc7-ba39-a261f14331bb tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:00.857706 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-c1d705dd-d498-4cc7-ba39-a261f14331bb tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 200 len: 1735 microversion: 2.1 time: 0.237340 May 04 19:11:00.858214 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 327/671] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:11:00 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 1735 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:11:00.868435 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-1671ae82-64d0-43b3-9cf7-bcc23103d50b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:00.869085 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-1671ae82-64d0-43b3-9cf7-bcc23103d50b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: c0ca0b46-570c-45ff-820a-87a4197033f3] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:00.876205 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1671ae82-64d0-43b3-9cf7-bcc23103d50b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:00.876656 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1671ae82-64d0-43b3-9cf7-bcc23103d50b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:00.877439 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1671ae82-64d0-43b3-9cf7-bcc23103d50b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:00.877904 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1671ae82-64d0-43b3-9cf7-bcc23103d50b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:00.940801 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-1671ae82-64d0-43b3-9cf7-bcc23103d50b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:00.948843 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-1671ae82-64d0-43b3-9cf7-bcc23103d50b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/c0ca0b46-570c-45ff-820a-87a4197033f3" status: 200 len: 1290 microversion: 2.1 time: 0.084254 May 04 19:11:00.959561 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 345/672] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:11:00 2022] GET /compute/v2.1/servers/c0ca0b46-570c-45ff-820a-87a4197033f3 => generated 1290 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:11:01.875222 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-029572da-934f-4b6a-9545-96ceb5b7a1c3 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:01.875825 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-029572da-934f-4b6a-9545-96ceb5b7a1c3 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:01.882272 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-029572da-934f-4b6a-9545-96ceb5b7a1c3 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:01.882710 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-029572da-934f-4b6a-9545-96ceb5b7a1c3 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:01.883463 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-029572da-934f-4b6a-9545-96ceb5b7a1c3 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:01.883891 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-029572da-934f-4b6a-9545-96ceb5b7a1c3 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:01.967195 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-91de0392-5ceb-46ae-9162-cb7f6deb102e tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:01.968673 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-91de0392-5ceb-46ae-9162-cb7f6deb102e tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: c0ca0b46-570c-45ff-820a-87a4197033f3] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:01.975476 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-91de0392-5ceb-46ae-9162-cb7f6deb102e tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:01.975922 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-91de0392-5ceb-46ae-9162-cb7f6deb102e tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:01.976708 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-91de0392-5ceb-46ae-9162-cb7f6deb102e tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:01.977346 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-91de0392-5ceb-46ae-9162-cb7f6deb102e tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:02.015088 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-029572da-934f-4b6a-9545-96ceb5b7a1c3 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:02.023835 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-029572da-934f-4b6a-9545-96ceb5b7a1c3 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 200 len: 1735 microversion: 2.1 time: 0.152353 May 04 19:11:02.024698 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 328/673] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:11:01 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:11:02.043923 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-91de0392-5ceb-46ae-9162-cb7f6deb102e tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:02.051365 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-91de0392-5ceb-46ae-9162-cb7f6deb102e tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/c0ca0b46-570c-45ff-820a-87a4197033f3" status: 200 len: 1296 microversion: 2.1 time: 0.087958 May 04 19:11:02.051937 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 346/674] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:11:01 2022] GET /compute/v2.1/servers/c0ca0b46-570c-45ff-820a-87a4197033f3 => generated 1296 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:11:03.051299 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-aa6e34fc-d7fb-43aa-908b-1f915d498ca9 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:03.069430 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-609cd1ee-ac0d-49ae-b211-a62a95ee30cd tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:03.069976 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-aa6e34fc-d7fb-43aa-908b-1f915d498ca9 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:03.070367 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-609cd1ee-ac0d-49ae-b211-a62a95ee30cd tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: c0ca0b46-570c-45ff-820a-87a4197033f3] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:03.076930 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-609cd1ee-ac0d-49ae-b211-a62a95ee30cd tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:03.078794 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-609cd1ee-ac0d-49ae-b211-a62a95ee30cd tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:03.079754 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-609cd1ee-ac0d-49ae-b211-a62a95ee30cd tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:03.080641 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-609cd1ee-ac0d-49ae-b211-a62a95ee30cd tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:03.081592 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-aa6e34fc-d7fb-43aa-908b-1f915d498ca9 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:03.082049 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-aa6e34fc-d7fb-43aa-908b-1f915d498ca9 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:03.082860 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-aa6e34fc-d7fb-43aa-908b-1f915d498ca9 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:03.083301 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-aa6e34fc-d7fb-43aa-908b-1f915d498ca9 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:03.241391 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-609cd1ee-ac0d-49ae-b211-a62a95ee30cd tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:03.248764 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-609cd1ee-ac0d-49ae-b211-a62a95ee30cd tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/c0ca0b46-570c-45ff-820a-87a4197033f3" status: 200 len: 1364 microversion: 2.1 time: 0.183493 May 04 19:11:03.249421 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 347/675] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:11:03 2022] GET /compute/v2.1/servers/c0ca0b46-570c-45ff-820a-87a4197033f3 => generated 1364 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:11:03.336183 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-aa6e34fc-d7fb-43aa-908b-1f915d498ca9 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:03.344011 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-aa6e34fc-d7fb-43aa-908b-1f915d498ca9 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 200 len: 1735 microversion: 2.1 time: 0.306698 May 04 19:11:03.344575 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 329/676] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:11:03 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 1735 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:11:03.674197 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-03880807-bd2c-456d-ab20-30644bda11ae req-693ff871-4dee-4ee4-9fcb-b1be29674573 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0ca0b46-570c-45ff-820a-87a4197033f3", "tag": "24608008-ae36-4f07-bcff-72a1c2a095b8"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:11:03.693827 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-03880807-bd2c-456d-ab20-30644bda11ae req-693ff871-4dee-4ee4-9fcb-b1be29674573 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:03.694569 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-03880807-bd2c-456d-ab20-30644bda11ae req-693ff871-4dee-4ee4-9fcb-b1be29674573 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:03.707873 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-03880807-bd2c-456d-ab20-30644bda11ae req-693ff871-4dee-4ee4-9fcb-b1be29674573 service nova] Creating event network-changed:24608008-ae36-4f07-bcff-72a1c2a095b8 for instance c0ca0b46-570c-45ff-820a-87a4197033f3 on hv-cinder-83090 May 04 19:11:03.716844 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-03880807-bd2c-456d-ab20-30644bda11ae req-693ff871-4dee-4ee4-9fcb-b1be29674573 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046911 May 04 19:11:03.717441 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 348/677] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 04 19:11:04.265619 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-b0ec66c9-251e-42c1-890f-961eaf72ea65 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:04.266168 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-b0ec66c9-251e-42c1-890f-961eaf72ea65 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: c0ca0b46-570c-45ff-820a-87a4197033f3] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:04.272702 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b0ec66c9-251e-42c1-890f-961eaf72ea65 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:04.273153 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b0ec66c9-251e-42c1-890f-961eaf72ea65 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:04.273977 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b0ec66c9-251e-42c1-890f-961eaf72ea65 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:04.274413 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b0ec66c9-251e-42c1-890f-961eaf72ea65 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:04.364320 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-d743682e-b95f-4155-bd18-06a53d4df6d1 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:04.365015 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-d743682e-b95f-4155-bd18-06a53d4df6d1 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:04.371546 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d743682e-b95f-4155-bd18-06a53d4df6d1 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:04.371996 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d743682e-b95f-4155-bd18-06a53d4df6d1 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:04.372753 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d743682e-b95f-4155-bd18-06a53d4df6d1 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:04.373185 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d743682e-b95f-4155-bd18-06a53d4df6d1 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:04.410247 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-b0ec66c9-251e-42c1-890f-961eaf72ea65 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:04.422206 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-b0ec66c9-251e-42c1-890f-961eaf72ea65 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/c0ca0b46-570c-45ff-820a-87a4197033f3" status: 200 len: 1364 microversion: 2.1 time: 0.160242 May 04 19:11:04.422792 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 330/678] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:11:04 2022] GET /compute/v2.1/servers/c0ca0b46-570c-45ff-820a-87a4197033f3 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:11:04.509481 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-d743682e-b95f-4155-bd18-06a53d4df6d1 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:04.517932 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-d743682e-b95f-4155-bd18-06a53d4df6d1 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 200 len: 1715 microversion: 2.1 time: 0.157977 May 04 19:11:04.518800 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 349/679] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:11:04 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 1715 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:11:04.621959 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-6a00fb08-fb83-4865-b4f3-41d3b70ee1c4 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:04.622568 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-6a00fb08-fb83-4865-b4f3-41d3b70ee1c4 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:04.628567 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6a00fb08-fb83-4865-b4f3-41d3b70ee1c4 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:04.629090 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6a00fb08-fb83-4865-b4f3-41d3b70ee1c4 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:04.629996 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6a00fb08-fb83-4865-b4f3-41d3b70ee1c4 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:04.630503 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6a00fb08-fb83-4865-b4f3-41d3b70ee1c4 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:04.712928 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.wsgi [None req-6a00fb08-fb83-4865-b4f3-41d3b70ee1c4 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] HTTP exception thrown: Cannot 'detach_volume' instance 17de0a81-ab42-475e-b6f3-dd853adc826c while it is in vm_state rescued May 04 19:11:04.713570 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-6a00fb08-fb83-4865-b4f3-41d3b70ee1c4 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Returning 409 to user: Cannot 'detach_volume' instance 17de0a81-ab42-475e-b6f3-dd853adc826c while it is in vm_state rescued {{(pid=117125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 04 19:11:04.714404 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-6a00fb08-fb83-4865-b4f3-41d3b70ee1c4 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "DELETE /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c/os-volume_attachments/70f7367c-249b-4a7d-8b81-9cc0d2c5d772" status: 409 len: 152 microversion: 2.1 time: 0.096542 May 04 19:11:04.714956 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 331/680] 10.222.0.69 () {58 vars in 1415 bytes} [Wed May 4 19:11:04 2022] DELETE /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c/os-volume_attachments/70f7367c-249b-4a7d-8b81-9cc0d2c5d772 => generated 152 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 04 19:11:04.723231 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-ff48aad5-1b36-41ff-ad4f-912b9b4e5f80 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:11:04.723972 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-ff48aad5-1b36-41ff-ad4f-912b9b4e5f80 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:04.730217 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ff48aad5-1b36-41ff-ad4f-912b9b4e5f80 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:04.730667 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ff48aad5-1b36-41ff-ad4f-912b9b4e5f80 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:04.731437 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ff48aad5-1b36-41ff-ad4f-912b9b4e5f80 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:04.731869 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ff48aad5-1b36-41ff-ad4f-912b9b4e5f80 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:04.810657 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-ff48aad5-1b36-41ff-ad4f-912b9b4e5f80 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "POST /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c/action" status: 202 len: 0 microversion: 2.1 time: 0.090872 May 04 19:11:04.811393 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 350/681] 10.222.0.69 () {60 vars in 1277 bytes} [Wed May 4 19:11:04 2022] POST /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 04 19:11:04.820617 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-68b234da-7806-4ef0-996a-b4dfb396340e tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:04.821318 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-68b234da-7806-4ef0-996a-b4dfb396340e tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:04.830315 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-68b234da-7806-4ef0-996a-b4dfb396340e tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:04.833867 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-68b234da-7806-4ef0-996a-b4dfb396340e tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:04.834943 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-68b234da-7806-4ef0-996a-b4dfb396340e tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:04.835617 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-68b234da-7806-4ef0-996a-b4dfb396340e tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:05.000158 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-68b234da-7806-4ef0-996a-b4dfb396340e tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:05.008954 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-68b234da-7806-4ef0-996a-b4dfb396340e tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 200 len: 1723 microversion: 2.1 time: 0.192658 May 04 19:11:05.009546 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 332/682] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:11:04 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:11:05.440449 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-fa3ff846-138c-428d-949e-a21dc93b4e78 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:05.441067 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-fa3ff846-138c-428d-949e-a21dc93b4e78 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: c0ca0b46-570c-45ff-820a-87a4197033f3] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:05.447618 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fa3ff846-138c-428d-949e-a21dc93b4e78 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:05.448072 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fa3ff846-138c-428d-949e-a21dc93b4e78 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:05.448835 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fa3ff846-138c-428d-949e-a21dc93b4e78 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:05.449272 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fa3ff846-138c-428d-949e-a21dc93b4e78 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:05.583014 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-fa3ff846-138c-428d-949e-a21dc93b4e78 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:05.591387 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-fa3ff846-138c-428d-949e-a21dc93b4e78 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/c0ca0b46-570c-45ff-820a-87a4197033f3" status: 200 len: 1364 microversion: 2.1 time: 0.155126 May 04 19:11:05.591978 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 351/683] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:11:05 2022] GET /compute/v2.1/servers/c0ca0b46-570c-45ff-820a-87a4197033f3 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:11:06.028254 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-5a5d3b2f-59a2-4041-a8c4-e583d3eec31c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:06.028964 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-5a5d3b2f-59a2-4041-a8c4-e583d3eec31c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:06.037943 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5a5d3b2f-59a2-4041-a8c4-e583d3eec31c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:06.038505 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5a5d3b2f-59a2-4041-a8c4-e583d3eec31c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:06.039355 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5a5d3b2f-59a2-4041-a8c4-e583d3eec31c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:06.039866 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5a5d3b2f-59a2-4041-a8c4-e583d3eec31c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:06.238096 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-5a5d3b2f-59a2-4041-a8c4-e583d3eec31c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:06.250368 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-5a5d3b2f-59a2-4041-a8c4-e583d3eec31c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 200 len: 1723 microversion: 2.1 time: 0.227176 May 04 19:11:06.251056 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 333/684] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:11:06 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 1723 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:11:06.608653 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-37fe5305-a6c4-43cf-a2e6-f72096b1fbae tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:06.609294 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-37fe5305-a6c4-43cf-a2e6-f72096b1fbae tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: c0ca0b46-570c-45ff-820a-87a4197033f3] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:06.617839 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-37fe5305-a6c4-43cf-a2e6-f72096b1fbae tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:06.618348 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-37fe5305-a6c4-43cf-a2e6-f72096b1fbae tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:06.619138 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-37fe5305-a6c4-43cf-a2e6-f72096b1fbae tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:06.619578 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-37fe5305-a6c4-43cf-a2e6-f72096b1fbae tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:06.762059 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-37fe5305-a6c4-43cf-a2e6-f72096b1fbae tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:06.769612 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-37fe5305-a6c4-43cf-a2e6-f72096b1fbae tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/c0ca0b46-570c-45ff-820a-87a4197033f3" status: 200 len: 1364 microversion: 2.1 time: 0.164827 May 04 19:11:06.770169 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 352/685] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:11:06 2022] GET /compute/v2.1/servers/c0ca0b46-570c-45ff-820a-87a4197033f3 => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:11:07.269376 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-bbc7c817-f42b-4d15-860a-d0b75a3b9a44 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:07.270029 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-bbc7c817-f42b-4d15-860a-d0b75a3b9a44 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:07.277435 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-bbc7c817-f42b-4d15-860a-d0b75a3b9a44 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:07.277921 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-bbc7c817-f42b-4d15-860a-d0b75a3b9a44 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:07.278688 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-bbc7c817-f42b-4d15-860a-d0b75a3b9a44 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:07.279122 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-bbc7c817-f42b-4d15-860a-d0b75a3b9a44 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:07.414164 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-bbc7c817-f42b-4d15-860a-d0b75a3b9a44 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:07.422943 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-bbc7c817-f42b-4d15-860a-d0b75a3b9a44 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 200 len: 1723 microversion: 2.1 time: 0.158643 May 04 19:11:07.423530 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 334/686] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:11:07 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:11:07.786329 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-57075639-9492-4370-abf6-53583621e6b8 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:07.786940 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-57075639-9492-4370-abf6-53583621e6b8 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: c0ca0b46-570c-45ff-820a-87a4197033f3] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:07.793833 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-57075639-9492-4370-abf6-53583621e6b8 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:07.794314 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-57075639-9492-4370-abf6-53583621e6b8 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:07.795499 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-57075639-9492-4370-abf6-53583621e6b8 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:07.795499 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-57075639-9492-4370-abf6-53583621e6b8 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:07.934888 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-57075639-9492-4370-abf6-53583621e6b8 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:07.942451 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-57075639-9492-4370-abf6-53583621e6b8 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/c0ca0b46-570c-45ff-820a-87a4197033f3" status: 200 len: 1364 microversion: 2.1 time: 0.159879 May 04 19:11:07.943034 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 353/687] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:11:07 2022] GET /compute/v2.1/servers/c0ca0b46-570c-45ff-820a-87a4197033f3 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:11:08.440082 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-406045bc-1032-4a07-842e-cd8c2f2df811 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:08.440683 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-406045bc-1032-4a07-842e-cd8c2f2df811 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:08.447618 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-406045bc-1032-4a07-842e-cd8c2f2df811 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:08.448134 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-406045bc-1032-4a07-842e-cd8c2f2df811 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:08.449043 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-406045bc-1032-4a07-842e-cd8c2f2df811 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:08.449523 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-406045bc-1032-4a07-842e-cd8c2f2df811 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:08.579185 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-406045bc-1032-4a07-842e-cd8c2f2df811 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:08.587460 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-406045bc-1032-4a07-842e-cd8c2f2df811 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 200 len: 1723 microversion: 2.1 time: 0.151262 May 04 19:11:08.588025 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 335/688] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:11:08 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:11:08.959479 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-83b833a5-9a1c-48f8-ab5f-374206804fcf tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:08.960839 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-83b833a5-9a1c-48f8-ab5f-374206804fcf tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: c0ca0b46-570c-45ff-820a-87a4197033f3] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:08.967634 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-83b833a5-9a1c-48f8-ab5f-374206804fcf tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:08.968083 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-83b833a5-9a1c-48f8-ab5f-374206804fcf tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:08.968848 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-83b833a5-9a1c-48f8-ab5f-374206804fcf tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:08.969282 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-83b833a5-9a1c-48f8-ab5f-374206804fcf tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:09.099965 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-83b833a5-9a1c-48f8-ab5f-374206804fcf tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:09.111481 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-83b833a5-9a1c-48f8-ab5f-374206804fcf tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/c0ca0b46-570c-45ff-820a-87a4197033f3" status: 200 len: 1364 microversion: 2.1 time: 0.155621 May 04 19:11:09.112748 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 354/689] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:11:08 2022] GET /compute/v2.1/servers/c0ca0b46-570c-45ff-820a-87a4197033f3 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:11:09.606130 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-979f64e3-e760-4d07-a0a4-1d92b072f6b5 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:09.606757 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-979f64e3-e760-4d07-a0a4-1d92b072f6b5 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:09.612964 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-979f64e3-e760-4d07-a0a4-1d92b072f6b5 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:09.613402 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-979f64e3-e760-4d07-a0a4-1d92b072f6b5 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:09.614194 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-979f64e3-e760-4d07-a0a4-1d92b072f6b5 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:09.614624 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-979f64e3-e760-4d07-a0a4-1d92b072f6b5 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:09.743479 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-979f64e3-e760-4d07-a0a4-1d92b072f6b5 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:09.765316 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-979f64e3-e760-4d07-a0a4-1d92b072f6b5 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 200 len: 1729 microversion: 2.1 time: 0.163569 May 04 19:11:09.765938 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 336/690] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:11:09 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:11:09.782468 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-4d423351-1fcd-45ed-a8ea-19b51e1447c0 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:09.782977 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-4d423351-1fcd-45ed-a8ea-19b51e1447c0 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:09.788968 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4d423351-1fcd-45ed-a8ea-19b51e1447c0 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:09.789414 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4d423351-1fcd-45ed-a8ea-19b51e1447c0 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:09.790200 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4d423351-1fcd-45ed-a8ea-19b51e1447c0 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:09.790647 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4d423351-1fcd-45ed-a8ea-19b51e1447c0 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:09.841961 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-c31bf7c6-c5f7-4a53-b853-cdced1fc5611 req-406245ac-5309-4475-8abd-b45ff7135042 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0ca0b46-570c-45ff-820a-87a4197033f3", "name": "network-vif-plugged", "status": "completed", "tag": "24608008-ae36-4f07-bcff-72a1c2a095b8"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:11:09.852082 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-c31bf7c6-c5f7-4a53-b853-cdced1fc5611 req-406245ac-5309-4475-8abd-b45ff7135042 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:09.852526 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-c31bf7c6-c5f7-4a53-b853-cdced1fc5611 req-406245ac-5309-4475-8abd-b45ff7135042 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:09.865391 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-c31bf7c6-c5f7-4a53-b853-cdced1fc5611 req-406245ac-5309-4475-8abd-b45ff7135042 service nova] Creating event network-vif-plugged:24608008-ae36-4f07-bcff-72a1c2a095b8 for instance c0ca0b46-570c-45ff-820a-87a4197033f3 on hv-cinder-83090 May 04 19:11:09.870188 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-4d423351-1fcd-45ed-a8ea-19b51e1447c0 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091592 May 04 19:11:09.870440 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-c31bf7c6-c5f7-4a53-b853-cdced1fc5611 req-406245ac-5309-4475-8abd-b45ff7135042 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033507 May 04 19:11:09.871046 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 337/691] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:11:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 04 19:11:09.871415 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 355/692] 10.222.0.69 () {58 vars in 1274 bytes} [Wed May 4 19:11:09 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:11:10.130685 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-b9ce5748-133a-41a5-8efd-5cb8281730a6 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:10.131379 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-b9ce5748-133a-41a5-8efd-5cb8281730a6 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: c0ca0b46-570c-45ff-820a-87a4197033f3] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:10.138218 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b9ce5748-133a-41a5-8efd-5cb8281730a6 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:10.138662 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b9ce5748-133a-41a5-8efd-5cb8281730a6 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:10.139425 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b9ce5748-133a-41a5-8efd-5cb8281730a6 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:10.140058 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b9ce5748-133a-41a5-8efd-5cb8281730a6 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:10.273284 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-b9ce5748-133a-41a5-8efd-5cb8281730a6 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:10.281400 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-b9ce5748-133a-41a5-8efd-5cb8281730a6 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/c0ca0b46-570c-45ff-820a-87a4197033f3" status: 200 len: 1364 microversion: 2.1 time: 0.155246 May 04 19:11:10.281671 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 338/693] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:11:10 2022] GET /compute/v2.1/servers/c0ca0b46-570c-45ff-820a-87a4197033f3 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:11:10.791514 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-5228150a-bab7-4fb0-a59a-fcfeb3a542f9 req-2d820ec5-f484-4b26-a3f5-3524ee3ea0cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17de0a81-ab42-475e-b6f3-dd853adc826c", "tag": "e11de5fb-b02b-4516-8fa9-a612b9b432a0"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:11:10.799999 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-5228150a-bab7-4fb0-a59a-fcfeb3a542f9 req-2d820ec5-f484-4b26-a3f5-3524ee3ea0cf service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:10.800437 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-5228150a-bab7-4fb0-a59a-fcfeb3a542f9 req-2d820ec5-f484-4b26-a3f5-3524ee3ea0cf service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:10.813343 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-5228150a-bab7-4fb0-a59a-fcfeb3a542f9 req-2d820ec5-f484-4b26-a3f5-3524ee3ea0cf service nova] Creating event network-changed:e11de5fb-b02b-4516-8fa9-a612b9b432a0 for instance 17de0a81-ab42-475e-b6f3-dd853adc826c on hv-cinder-83090 May 04 19:11:10.818540 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-5228150a-bab7-4fb0-a59a-fcfeb3a542f9 req-2d820ec5-f484-4b26-a3f5-3524ee3ea0cf service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031581 May 04 19:11:10.819468 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 356/694] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:11:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:11:11.298290 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-e16822e7-e964-44e5-8f94-47c2820b4a60 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:11.298905 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-e16822e7-e964-44e5-8f94-47c2820b4a60 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: c0ca0b46-570c-45ff-820a-87a4197033f3] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:11.305940 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e16822e7-e964-44e5-8f94-47c2820b4a60 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:11.306393 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e16822e7-e964-44e5-8f94-47c2820b4a60 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:11.307166 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e16822e7-e964-44e5-8f94-47c2820b4a60 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:11.307606 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e16822e7-e964-44e5-8f94-47c2820b4a60 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:11.568995 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-e16822e7-e964-44e5-8f94-47c2820b4a60 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:11.576905 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-e16822e7-e964-44e5-8f94-47c2820b4a60 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/c0ca0b46-570c-45ff-820a-87a4197033f3" status: 200 len: 1364 microversion: 2.1 time: 0.282439 May 04 19:11:11.577488 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 339/695] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:11:11 2022] GET /compute/v2.1/servers/c0ca0b46-570c-45ff-820a-87a4197033f3 => generated 1364 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:11:12.594756 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-e6f03892-c60d-48ac-980d-a543b65cfee7 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:12.595508 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-e6f03892-c60d-48ac-980d-a543b65cfee7 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: c0ca0b46-570c-45ff-820a-87a4197033f3] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:12.602351 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e6f03892-c60d-48ac-980d-a543b65cfee7 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:12.602777 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e6f03892-c60d-48ac-980d-a543b65cfee7 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:12.604116 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e6f03892-c60d-48ac-980d-a543b65cfee7 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:12.604549 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e6f03892-c60d-48ac-980d-a543b65cfee7 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:12.783267 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-e6f03892-c60d-48ac-980d-a543b65cfee7 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:12.790556 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-e6f03892-c60d-48ac-980d-a543b65cfee7 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/c0ca0b46-570c-45ff-820a-87a4197033f3" status: 200 len: 1551 microversion: 2.1 time: 0.200064 May 04 19:11:12.791767 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 357/696] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:11:12 2022] GET /compute/v2.1/servers/c0ca0b46-570c-45ff-820a-87a4197033f3 => generated 1551 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:11:12.807360 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-ec960521-20dd-4c48-ac45-e00fb3b4a8b5 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:12.807865 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-ec960521-20dd-4c48-ac45-e00fb3b4a8b5 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: c0ca0b46-570c-45ff-820a-87a4197033f3] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:12.814151 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ec960521-20dd-4c48-ac45-e00fb3b4a8b5 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:12.814598 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ec960521-20dd-4c48-ac45-e00fb3b4a8b5 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:12.815360 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ec960521-20dd-4c48-ac45-e00fb3b4a8b5 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:12.815795 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ec960521-20dd-4c48-ac45-e00fb3b4a8b5 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:12.831844 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-194ca344-5824-440b-8a05-7c9b0c013147 req-46c30464-52db-4c23-91e4-ab77aa6b2a23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17de0a81-ab42-475e-b6f3-dd853adc826c", "tag": "e11de5fb-b02b-4516-8fa9-a612b9b432a0"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:11:12.840413 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-194ca344-5824-440b-8a05-7c9b0c013147 req-46c30464-52db-4c23-91e4-ab77aa6b2a23 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:12.840820 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-194ca344-5824-440b-8a05-7c9b0c013147 req-46c30464-52db-4c23-91e4-ab77aa6b2a23 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:12.851886 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-194ca344-5824-440b-8a05-7c9b0c013147 req-46c30464-52db-4c23-91e4-ab77aa6b2a23 service nova] Creating event network-changed:e11de5fb-b02b-4516-8fa9-a612b9b432a0 for instance 17de0a81-ab42-475e-b6f3-dd853adc826c on hv-cinder-83090 May 04 19:11:12.857477 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-194ca344-5824-440b-8a05-7c9b0c013147 req-46c30464-52db-4c23-91e4-ab77aa6b2a23 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029120 May 04 19:11:12.858321 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 358/697] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 04 19:11:12.896207 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-ec960521-20dd-4c48-ac45-e00fb3b4a8b5 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/c0ca0b46-570c-45ff-820a-87a4197033f3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092677 May 04 19:11:12.896803 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 340/698] 10.222.0.69 () {58 vars in 1274 bytes} [Wed May 4 19:11:12 2022] GET /compute/v2.1/servers/c0ca0b46-570c-45ff-820a-87a4197033f3/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:11:14.397055 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-f5743fe0-216d-47cc-859b-a5fbd62ee9f5 req-da2b2608-149f-4f85-af18-334bfea88807 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0ca0b46-570c-45ff-820a-87a4197033f3", "tag": "24608008-ae36-4f07-bcff-72a1c2a095b8"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:11:14.407391 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-f5743fe0-216d-47cc-859b-a5fbd62ee9f5 req-da2b2608-149f-4f85-af18-334bfea88807 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:14.408209 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-f5743fe0-216d-47cc-859b-a5fbd62ee9f5 req-da2b2608-149f-4f85-af18-334bfea88807 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:14.420161 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-f5743fe0-216d-47cc-859b-a5fbd62ee9f5 req-da2b2608-149f-4f85-af18-334bfea88807 service nova] Creating event network-changed:24608008-ae36-4f07-bcff-72a1c2a095b8 for instance c0ca0b46-570c-45ff-820a-87a4197033f3 on hv-cinder-83090 May 04 19:11:14.425251 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-f5743fe0-216d-47cc-859b-a5fbd62ee9f5 req-da2b2608-149f-4f85-af18-334bfea88807 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034138 May 04 19:11:14.425998 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 359/699] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:11:15.434046 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-4acc0719-2934-49f6-b50b-6c08d17d76d3 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1345285705", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-630419074", "security_groups": [{"name": "tempest-secgroup-smoke-329240155"}], "block_device_mapping_v2": [{"uuid": "7d72d0ef-50c5-4234-845a-8c1be9cbe341", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f15a6490-097f-4027-b3d2-f33625a578b7"}]}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:11:15.546758 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.network.neutron [None req-4acc0719-2934-49f6-b50b-6c08d17d76d3 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] validate_networks() for [('f15a6490-097f-4027-b3d2-f33625a578b7', None, None, None, None, None)] {{(pid=117125) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 04 19:11:16.195164 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-4acc0719-2934-49f6-b50b-6c08d17d76d3 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Flavor limits 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 04 19:11:16.196153 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-4acc0719-2934-49f6-b50b-6c08d17d76d3 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Image limits 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 04 19:11:16.196153 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-4acc0719-2934-49f6-b50b-6c08d17d76d3 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Flavor pref 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 04 19:11:16.196448 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-4acc0719-2934-49f6-b50b-6c08d17d76d3 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Image pref 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 04 19:11:16.196852 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-4acc0719-2934-49f6-b50b-6c08d17d76d3 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 04 19:11:16.206159 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4acc0719-2934-49f6-b50b-6c08d17d76d3 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:16.206614 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4acc0719-2934-49f6-b50b-6c08d17d76d3 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:16.207406 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4acc0719-2934-49f6-b50b-6c08d17d76d3 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:16.207840 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4acc0719-2934-49f6-b50b-6c08d17d76d3 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:16.224624 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-4acc0719-2934-49f6-b50b-6c08d17d76d3 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Getting quotas for project 157e9c40125e42b4b5a908fc58bfa939. Resources: {'cores', 'ram', 'instances'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 04 19:11:16.228616 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-4acc0719-2934-49f6-b50b-6c08d17d76d3 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Getting quotas for user 3c8b295066bc4ae695f6e60b9b3dc5dd and project 157e9c40125e42b4b5a908fc58bfa939. Resources: {'cores', 'ram', 'instances'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 04 19:11:16.285623 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-4acc0719-2934-49f6-b50b-6c08d17d76d3 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Going to run 1 instances... {{(pid=117125) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 04 19:11:16.287723 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-4acc0719-2934-49f6-b50b-6c08d17d76d3 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: a8c67aa1-879c-4bd2-a133-3d8319f9494a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7d72d0ef-50c5-4234-845a-8c1be9cbe341',volume_size=None,volume_type=None)] {{(pid=117125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 04 19:11:16.415268 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-4acc0719-2934-49f6-b50b-6c08d17d76d3 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.986214 May 04 19:11:16.416153 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 341/700] 10.222.0.69 () {60 vars in 1146 bytes} [Wed May 4 19:11:15 2022] POST /compute/v2.1/servers => generated 405 bytes in 988 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 04 19:11:16.426295 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-b7fa8a00-6fc9-4000-8a82-6d7d7605f74e tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:16.426924 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-b7fa8a00-6fc9-4000-8a82-6d7d7605f74e tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: a8c67aa1-879c-4bd2-a133-3d8319f9494a] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:16.486675 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-b7fa8a00-6fc9-4000-8a82-6d7d7605f74e tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8b295066bc4ae695f6e60b9b3dc5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157e9c40125e42b4b5a908fc58bfa939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:16.493322 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-b7fa8a00-6fc9-4000-8a82-6d7d7605f74e tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "GET /compute/v2.1/servers/a8c67aa1-879c-4bd2-a133-3d8319f9494a" status: 200 len: 1094 microversion: 2.1 time: 0.071135 May 04 19:11:16.499349 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 360/701] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:11:16 2022] GET /compute/v2.1/servers/a8c67aa1-879c-4bd2-a133-3d8319f9494a => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:11:17.512420 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-f1d10684-ce9b-41a2-9ab7-9cc5c4704721 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:17.512940 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-f1d10684-ce9b-41a2-9ab7-9cc5c4704721 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: a8c67aa1-879c-4bd2-a133-3d8319f9494a] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:17.519199 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f1d10684-ce9b-41a2-9ab7-9cc5c4704721 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:17.519652 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f1d10684-ce9b-41a2-9ab7-9cc5c4704721 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:17.520420 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f1d10684-ce9b-41a2-9ab7-9cc5c4704721 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:17.520861 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f1d10684-ce9b-41a2-9ab7-9cc5c4704721 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:17.593120 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-f1d10684-ce9b-41a2-9ab7-9cc5c4704721 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8b295066bc4ae695f6e60b9b3dc5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157e9c40125e42b4b5a908fc58bfa939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:17.601069 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-f1d10684-ce9b-41a2-9ab7-9cc5c4704721 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "GET /compute/v2.1/servers/a8c67aa1-879c-4bd2-a133-3d8319f9494a" status: 200 len: 1192 microversion: 2.1 time: 0.094604 May 04 19:11:17.602772 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 342/702] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:11:17 2022] GET /compute/v2.1/servers/a8c67aa1-879c-4bd2-a133-3d8319f9494a => generated 1192 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:11:18.618991 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-2c5392cf-a28c-42ab-a021-b3023166071d tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:18.619601 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-2c5392cf-a28c-42ab-a021-b3023166071d tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: a8c67aa1-879c-4bd2-a133-3d8319f9494a] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:18.626530 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2c5392cf-a28c-42ab-a021-b3023166071d tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:18.626987 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2c5392cf-a28c-42ab-a021-b3023166071d tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:18.627751 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2c5392cf-a28c-42ab-a021-b3023166071d tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:18.628186 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2c5392cf-a28c-42ab-a021-b3023166071d tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:18.767021 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-2c5392cf-a28c-42ab-a021-b3023166071d tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8b295066bc4ae695f6e60b9b3dc5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157e9c40125e42b4b5a908fc58bfa939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:18.775792 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-2c5392cf-a28c-42ab-a021-b3023166071d tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "GET /compute/v2.1/servers/a8c67aa1-879c-4bd2-a133-3d8319f9494a" status: 200 len: 1265 microversion: 2.1 time: 0.160118 May 04 19:11:18.776383 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 361/703] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:11:18 2022] GET /compute/v2.1/servers/a8c67aa1-879c-4bd2-a133-3d8319f9494a => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:11:18.896271 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-6374f649-56de-4bf4-8b00-f516009e23f8 req-628865e5-bb32-408f-b5e0-b12365c88314 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8c67aa1-879c-4bd2-a133-3d8319f9494a", "tag": "60e7c55c-cf55-478e-8c07-010e76efb433"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:11:18.908310 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-6374f649-56de-4bf4-8b00-f516009e23f8 req-628865e5-bb32-408f-b5e0-b12365c88314 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:18.909196 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-6374f649-56de-4bf4-8b00-f516009e23f8 req-628865e5-bb32-408f-b5e0-b12365c88314 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:18.922890 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-6374f649-56de-4bf4-8b00-f516009e23f8 req-628865e5-bb32-408f-b5e0-b12365c88314 service nova] Creating event network-changed:60e7c55c-cf55-478e-8c07-010e76efb433 for instance a8c67aa1-879c-4bd2-a133-3d8319f9494a on hv-cinder-83090 May 04 19:11:18.930800 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-6374f649-56de-4bf4-8b00-f516009e23f8 req-628865e5-bb32-408f-b5e0-b12365c88314 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038128 May 04 19:11:18.931585 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 343/704] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:11:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:11:19.792843 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-84458df3-2bb3-48a5-b2ad-a93584cb610c tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:19.793502 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-84458df3-2bb3-48a5-b2ad-a93584cb610c tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: a8c67aa1-879c-4bd2-a133-3d8319f9494a] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:19.799829 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-84458df3-2bb3-48a5-b2ad-a93584cb610c tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:19.800274 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-84458df3-2bb3-48a5-b2ad-a93584cb610c tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:19.801041 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-84458df3-2bb3-48a5-b2ad-a93584cb610c tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:19.801486 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-84458df3-2bb3-48a5-b2ad-a93584cb610c tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:19.928536 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-84458df3-2bb3-48a5-b2ad-a93584cb610c tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8b295066bc4ae695f6e60b9b3dc5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157e9c40125e42b4b5a908fc58bfa939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:19.936069 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-84458df3-2bb3-48a5-b2ad-a93584cb610c tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "GET /compute/v2.1/servers/a8c67aa1-879c-4bd2-a133-3d8319f9494a" status: 200 len: 1265 microversion: 2.1 time: 0.147139 May 04 19:11:19.936667 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 362/705] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:11:19 2022] GET /compute/v2.1/servers/a8c67aa1-879c-4bd2-a133-3d8319f9494a => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:11:20.952509 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-da065ab7-2c80-45bd-bdb2-0a99cbd2b2a8 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:20.953263 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-da065ab7-2c80-45bd-bdb2-0a99cbd2b2a8 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: a8c67aa1-879c-4bd2-a133-3d8319f9494a] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:20.959919 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-da065ab7-2c80-45bd-bdb2-0a99cbd2b2a8 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:20.960367 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-da065ab7-2c80-45bd-bdb2-0a99cbd2b2a8 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:20.961130 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-da065ab7-2c80-45bd-bdb2-0a99cbd2b2a8 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:20.961654 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-da065ab7-2c80-45bd-bdb2-0a99cbd2b2a8 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:21.089779 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-da065ab7-2c80-45bd-bdb2-0a99cbd2b2a8 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8b295066bc4ae695f6e60b9b3dc5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157e9c40125e42b4b5a908fc58bfa939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:21.096983 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-da065ab7-2c80-45bd-bdb2-0a99cbd2b2a8 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "GET /compute/v2.1/servers/a8c67aa1-879c-4bd2-a133-3d8319f9494a" status: 200 len: 1265 microversion: 2.1 time: 0.148608 May 04 19:11:21.097573 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 344/706] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:11:20 2022] GET /compute/v2.1/servers/a8c67aa1-879c-4bd2-a133-3d8319f9494a => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:11:22.114379 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-d18607c9-315e-4d5d-b665-60a34f4f8ea0 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:22.114995 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-d18607c9-315e-4d5d-b665-60a34f4f8ea0 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: a8c67aa1-879c-4bd2-a133-3d8319f9494a] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:22.122134 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d18607c9-315e-4d5d-b665-60a34f4f8ea0 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:22.122587 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d18607c9-315e-4d5d-b665-60a34f4f8ea0 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:22.123355 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d18607c9-315e-4d5d-b665-60a34f4f8ea0 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:22.123795 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d18607c9-315e-4d5d-b665-60a34f4f8ea0 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:22.252410 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-d18607c9-315e-4d5d-b665-60a34f4f8ea0 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8b295066bc4ae695f6e60b9b3dc5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157e9c40125e42b4b5a908fc58bfa939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:22.259608 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-d18607c9-315e-4d5d-b665-60a34f4f8ea0 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "GET /compute/v2.1/servers/a8c67aa1-879c-4bd2-a133-3d8319f9494a" status: 200 len: 1265 microversion: 2.1 time: 0.149128 May 04 19:11:22.260183 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 363/707] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:11:22 2022] GET /compute/v2.1/servers/a8c67aa1-879c-4bd2-a133-3d8319f9494a => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:11:23.276465 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-627abc4f-7b3b-4a5c-b6e0-1db385720fe1 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:23.277017 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-627abc4f-7b3b-4a5c-b6e0-1db385720fe1 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: a8c67aa1-879c-4bd2-a133-3d8319f9494a] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:23.283399 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-627abc4f-7b3b-4a5c-b6e0-1db385720fe1 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:23.283849 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-627abc4f-7b3b-4a5c-b6e0-1db385720fe1 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:23.284619 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-627abc4f-7b3b-4a5c-b6e0-1db385720fe1 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:23.285055 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-627abc4f-7b3b-4a5c-b6e0-1db385720fe1 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:23.416767 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-627abc4f-7b3b-4a5c-b6e0-1db385720fe1 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8b295066bc4ae695f6e60b9b3dc5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157e9c40125e42b4b5a908fc58bfa939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:23.423986 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-627abc4f-7b3b-4a5c-b6e0-1db385720fe1 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "GET /compute/v2.1/servers/a8c67aa1-879c-4bd2-a133-3d8319f9494a" status: 200 len: 1265 microversion: 2.1 time: 0.151489 May 04 19:11:23.424549 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 345/708] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:11:23 2022] GET /compute/v2.1/servers/a8c67aa1-879c-4bd2-a133-3d8319f9494a => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:11:24.440298 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-c11fc45a-e07a-487e-b6db-a442b4ebfe9b tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:24.440904 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-c11fc45a-e07a-487e-b6db-a442b4ebfe9b tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: a8c67aa1-879c-4bd2-a133-3d8319f9494a] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:24.447225 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c11fc45a-e07a-487e-b6db-a442b4ebfe9b tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:24.447669 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c11fc45a-e07a-487e-b6db-a442b4ebfe9b tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:24.448417 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c11fc45a-e07a-487e-b6db-a442b4ebfe9b tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:24.449341 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c11fc45a-e07a-487e-b6db-a442b4ebfe9b tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:24.575029 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-c11fc45a-e07a-487e-b6db-a442b4ebfe9b tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8b295066bc4ae695f6e60b9b3dc5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157e9c40125e42b4b5a908fc58bfa939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:24.582148 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-c11fc45a-e07a-487e-b6db-a442b4ebfe9b tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "GET /compute/v2.1/servers/a8c67aa1-879c-4bd2-a133-3d8319f9494a" status: 200 len: 1265 microversion: 2.1 time: 0.145724 May 04 19:11:24.582712 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 364/709] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:11:24 2022] GET /compute/v2.1/servers/a8c67aa1-879c-4bd2-a133-3d8319f9494a => generated 1265 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:11:25.598638 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-ac6ae751-7d47-4d3c-852f-cc62c9a02ee2 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:25.599237 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-ac6ae751-7d47-4d3c-852f-cc62c9a02ee2 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: a8c67aa1-879c-4bd2-a133-3d8319f9494a] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:25.606125 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ac6ae751-7d47-4d3c-852f-cc62c9a02ee2 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:25.606574 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ac6ae751-7d47-4d3c-852f-cc62c9a02ee2 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:25.607321 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ac6ae751-7d47-4d3c-852f-cc62c9a02ee2 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:25.607750 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ac6ae751-7d47-4d3c-852f-cc62c9a02ee2 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:25.731847 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-ac6ae751-7d47-4d3c-852f-cc62c9a02ee2 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8b295066bc4ae695f6e60b9b3dc5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157e9c40125e42b4b5a908fc58bfa939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:25.738989 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-ac6ae751-7d47-4d3c-852f-cc62c9a02ee2 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "GET /compute/v2.1/servers/a8c67aa1-879c-4bd2-a133-3d8319f9494a" status: 200 len: 1265 microversion: 2.1 time: 0.144190 May 04 19:11:25.739553 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 346/710] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:11:25 2022] GET /compute/v2.1/servers/a8c67aa1-879c-4bd2-a133-3d8319f9494a => generated 1265 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:11:26.755648 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-a99e0f6c-5492-4928-a1fc-8c9fe5df5292 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:26.756253 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-a99e0f6c-5492-4928-a1fc-8c9fe5df5292 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: a8c67aa1-879c-4bd2-a133-3d8319f9494a] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:26.762656 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a99e0f6c-5492-4928-a1fc-8c9fe5df5292 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:26.763105 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a99e0f6c-5492-4928-a1fc-8c9fe5df5292 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:26.763871 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a99e0f6c-5492-4928-a1fc-8c9fe5df5292 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:26.764309 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a99e0f6c-5492-4928-a1fc-8c9fe5df5292 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:26.894760 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-a99e0f6c-5492-4928-a1fc-8c9fe5df5292 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8b295066bc4ae695f6e60b9b3dc5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157e9c40125e42b4b5a908fc58bfa939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:26.902475 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-a99e0f6c-5492-4928-a1fc-8c9fe5df5292 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "GET /compute/v2.1/servers/a8c67aa1-879c-4bd2-a133-3d8319f9494a" status: 200 len: 1265 microversion: 2.1 time: 0.150286 May 04 19:11:26.903036 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 365/711] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:11:26 2022] GET /compute/v2.1/servers/a8c67aa1-879c-4bd2-a133-3d8319f9494a => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:11:27.919680 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-f9beeb72-5c44-4a70-9648-0730f0f9e7a1 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:27.920264 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-f9beeb72-5c44-4a70-9648-0730f0f9e7a1 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: a8c67aa1-879c-4bd2-a133-3d8319f9494a] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:27.926821 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f9beeb72-5c44-4a70-9648-0730f0f9e7a1 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:27.927271 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f9beeb72-5c44-4a70-9648-0730f0f9e7a1 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:27.928034 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f9beeb72-5c44-4a70-9648-0730f0f9e7a1 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:27.928465 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f9beeb72-5c44-4a70-9648-0730f0f9e7a1 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:28.070109 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-f9beeb72-5c44-4a70-9648-0730f0f9e7a1 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8b295066bc4ae695f6e60b9b3dc5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157e9c40125e42b4b5a908fc58bfa939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:28.080118 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-f9beeb72-5c44-4a70-9648-0730f0f9e7a1 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "GET /compute/v2.1/servers/a8c67aa1-879c-4bd2-a133-3d8319f9494a" status: 200 len: 1265 microversion: 2.1 time: 0.164668 May 04 19:11:28.080978 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 347/712] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:11:27 2022] GET /compute/v2.1/servers/a8c67aa1-879c-4bd2-a133-3d8319f9494a => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:11:29.101803 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-bc632238-1219-40ff-b12e-aaa930ccd22a tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:29.102420 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-bc632238-1219-40ff-b12e-aaa930ccd22a tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: a8c67aa1-879c-4bd2-a133-3d8319f9494a] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:29.108363 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-bc632238-1219-40ff-b12e-aaa930ccd22a tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:29.108822 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-bc632238-1219-40ff-b12e-aaa930ccd22a tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:29.109613 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-bc632238-1219-40ff-b12e-aaa930ccd22a tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:29.110056 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-bc632238-1219-40ff-b12e-aaa930ccd22a tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:29.233548 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-bc632238-1219-40ff-b12e-aaa930ccd22a tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8b295066bc4ae695f6e60b9b3dc5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157e9c40125e42b4b5a908fc58bfa939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:29.240726 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-bc632238-1219-40ff-b12e-aaa930ccd22a tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "GET /compute/v2.1/servers/a8c67aa1-879c-4bd2-a133-3d8319f9494a" status: 200 len: 1265 microversion: 2.1 time: 0.143018 May 04 19:11:29.241290 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 366/713] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:11:29 2022] GET /compute/v2.1/servers/a8c67aa1-879c-4bd2-a133-3d8319f9494a => generated 1265 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:11:29.969126 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-75304546-6239-44de-8ff7-3939cac1c7de req-3efc62f1-7d71-4d4b-86dc-e9f34cb9eb6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8c67aa1-879c-4bd2-a133-3d8319f9494a", "name": "network-vif-plugged", "status": "completed", "tag": "60e7c55c-cf55-478e-8c07-010e76efb433"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:11:29.981680 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-75304546-6239-44de-8ff7-3939cac1c7de req-3efc62f1-7d71-4d4b-86dc-e9f34cb9eb6a service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:29.982146 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-75304546-6239-44de-8ff7-3939cac1c7de req-3efc62f1-7d71-4d4b-86dc-e9f34cb9eb6a service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:29.993517 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-75304546-6239-44de-8ff7-3939cac1c7de req-3efc62f1-7d71-4d4b-86dc-e9f34cb9eb6a service nova] Creating event network-vif-plugged:60e7c55c-cf55-478e-8c07-010e76efb433 for instance a8c67aa1-879c-4bd2-a133-3d8319f9494a on hv-cinder-83090 May 04 19:11:29.998536 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-75304546-6239-44de-8ff7-3939cac1c7de req-3efc62f1-7d71-4d4b-86dc-e9f34cb9eb6a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032970 May 04 19:11:29.999136 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 348/714] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:11:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:11:30.257775 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-3f8f18b4-f8cd-44a1-9b9a-7b6accd7df3a tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:30.258336 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-3f8f18b4-f8cd-44a1-9b9a-7b6accd7df3a tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: a8c67aa1-879c-4bd2-a133-3d8319f9494a] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:30.265062 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3f8f18b4-f8cd-44a1-9b9a-7b6accd7df3a tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:30.265546 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3f8f18b4-f8cd-44a1-9b9a-7b6accd7df3a tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:30.266318 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3f8f18b4-f8cd-44a1-9b9a-7b6accd7df3a tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:30.267011 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3f8f18b4-f8cd-44a1-9b9a-7b6accd7df3a tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:30.397059 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-3f8f18b4-f8cd-44a1-9b9a-7b6accd7df3a tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8b295066bc4ae695f6e60b9b3dc5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157e9c40125e42b4b5a908fc58bfa939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:30.404944 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-3f8f18b4-f8cd-44a1-9b9a-7b6accd7df3a tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "GET /compute/v2.1/servers/a8c67aa1-879c-4bd2-a133-3d8319f9494a" status: 200 len: 1265 microversion: 2.1 time: 0.151152 May 04 19:11:30.405531 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 367/715] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:11:30 2022] GET /compute/v2.1/servers/a8c67aa1-879c-4bd2-a133-3d8319f9494a => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:11:31.423414 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-e9c705c9-56fc-4b5b-bb18-cd2e30ec5b5d tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:31.424105 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-e9c705c9-56fc-4b5b-bb18-cd2e30ec5b5d tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: a8c67aa1-879c-4bd2-a133-3d8319f9494a] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:31.430613 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e9c705c9-56fc-4b5b-bb18-cd2e30ec5b5d tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:31.431054 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e9c705c9-56fc-4b5b-bb18-cd2e30ec5b5d tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:31.431804 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e9c705c9-56fc-4b5b-bb18-cd2e30ec5b5d tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:31.432230 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e9c705c9-56fc-4b5b-bb18-cd2e30ec5b5d tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:31.559346 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-e9c705c9-56fc-4b5b-bb18-cd2e30ec5b5d tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8b295066bc4ae695f6e60b9b3dc5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157e9c40125e42b4b5a908fc58bfa939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:31.566575 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-e9c705c9-56fc-4b5b-bb18-cd2e30ec5b5d tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "GET /compute/v2.1/servers/a8c67aa1-879c-4bd2-a133-3d8319f9494a" status: 200 len: 1265 microversion: 2.1 time: 0.147288 May 04 19:11:31.567198 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 349/716] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:11:31 2022] GET /compute/v2.1/servers/a8c67aa1-879c-4bd2-a133-3d8319f9494a => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:11:32.584369 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-5f9b664f-1a3c-4627-a4de-4a35bced9d20 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:32.584981 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-5f9b664f-1a3c-4627-a4de-4a35bced9d20 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: a8c67aa1-879c-4bd2-a133-3d8319f9494a] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:32.591934 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5f9b664f-1a3c-4627-a4de-4a35bced9d20 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:32.592383 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5f9b664f-1a3c-4627-a4de-4a35bced9d20 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:32.593146 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5f9b664f-1a3c-4627-a4de-4a35bced9d20 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:32.593621 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5f9b664f-1a3c-4627-a4de-4a35bced9d20 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:32.717708 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-5f9b664f-1a3c-4627-a4de-4a35bced9d20 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8b295066bc4ae695f6e60b9b3dc5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157e9c40125e42b4b5a908fc58bfa939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:32.724958 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-5f9b664f-1a3c-4627-a4de-4a35bced9d20 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "GET /compute/v2.1/servers/a8c67aa1-879c-4bd2-a133-3d8319f9494a" status: 200 len: 1452 microversion: 2.1 time: 0.144425 May 04 19:11:32.725536 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 368/717] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:11:32 2022] GET /compute/v2.1/servers/a8c67aa1-879c-4bd2-a133-3d8319f9494a => generated 1452 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:11:32.740873 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-c227c097-da68-4357-aba5-9f5aed810bd6 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:32.741498 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-c227c097-da68-4357-aba5-9f5aed810bd6 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: a8c67aa1-879c-4bd2-a133-3d8319f9494a] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:32.747802 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c227c097-da68-4357-aba5-9f5aed810bd6 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:32.748251 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c227c097-da68-4357-aba5-9f5aed810bd6 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:32.749012 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c227c097-da68-4357-aba5-9f5aed810bd6 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:32.749445 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c227c097-da68-4357-aba5-9f5aed810bd6 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:32.876939 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-c227c097-da68-4357-aba5-9f5aed810bd6 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8b295066bc4ae695f6e60b9b3dc5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157e9c40125e42b4b5a908fc58bfa939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:32.884142 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-c227c097-da68-4357-aba5-9f5aed810bd6 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "GET /compute/v2.1/servers/a8c67aa1-879c-4bd2-a133-3d8319f9494a" status: 200 len: 1452 microversion: 2.1 time: 0.147054 May 04 19:11:32.884703 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 350/718] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:11:32 2022] GET /compute/v2.1/servers/a8c67aa1-879c-4bd2-a133-3d8319f9494a => generated 1452 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:11:34.619225 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-ec737aad-6e10-4112-a7ca-de5122dd8709 req-a964e8b4-327c-43ee-8326-484b099f3191 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8c67aa1-879c-4bd2-a133-3d8319f9494a", "tag": "60e7c55c-cf55-478e-8c07-010e76efb433"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:11:34.628081 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-ec737aad-6e10-4112-a7ca-de5122dd8709 req-a964e8b4-327c-43ee-8326-484b099f3191 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:34.628548 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-ec737aad-6e10-4112-a7ca-de5122dd8709 req-a964e8b4-327c-43ee-8326-484b099f3191 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:34.639997 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-ec737aad-6e10-4112-a7ca-de5122dd8709 req-a964e8b4-327c-43ee-8326-484b099f3191 service nova] Creating event network-changed:60e7c55c-cf55-478e-8c07-010e76efb433 for instance a8c67aa1-879c-4bd2-a133-3d8319f9494a on hv-cinder-83090 May 04 19:11:34.645282 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-ec737aad-6e10-4112-a7ca-de5122dd8709 req-a964e8b4-327c-43ee-8326-484b099f3191 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029693 May 04 19:11:34.645927 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 369/719] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:11:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:11:34.997736 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-5323d003-3b8c-4dc3-9aaf-1d61efe573b3 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:34.998221 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-5323d003-3b8c-4dc3-9aaf-1d61efe573b3 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:35.004041 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5323d003-3b8c-4dc3-9aaf-1d61efe573b3 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:35.004486 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5323d003-3b8c-4dc3-9aaf-1d61efe573b3 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:35.005254 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5323d003-3b8c-4dc3-9aaf-1d61efe573b3 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:35.005722 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5323d003-3b8c-4dc3-9aaf-1d61efe573b3 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:35.028742 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-5323d003-3b8c-4dc3-9aaf-1d61efe573b3 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6/ips" status: 200 len: 152 microversion: 2.20 time: 0.148124 May 04 19:11:35.034295 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 351/720] 10.222.0.69 () {60 vars in 1288 bytes} [Wed May 4 19:11:34 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6/ips => generated 152 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 04 19:11:36.927358 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-eb1a4846-9230-4f04-a4f5-c8ee5b2faf2b tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:11:36.927999 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-eb1a4846-9230-4f04-a4f5-c8ee5b2faf2b tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:36.934379 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-eb1a4846-9230-4f04-a4f5-c8ee5b2faf2b tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:36.934756 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-eb1a4846-9230-4f04-a4f5-c8ee5b2faf2b tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:36.935515 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-eb1a4846-9230-4f04-a4f5-c8ee5b2faf2b tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:36.935981 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-eb1a4846-9230-4f04-a4f5-c8ee5b2faf2b tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:36.960149 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.objects.instance [None req-eb1a4846-9230-4f04-a4f5-c8ee5b2faf2b tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lazy-loading 'flavor' on Instance uuid bc9f6260-f308-4f45-809e-40f50eeb47d6 {{(pid=117124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 04 19:11:37.254445 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-eb1a4846-9230-4f04-a4f5-c8ee5b2faf2b tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "POST /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6/action" status: 202 len: 0 microversion: 2.20 time: 0.331635 May 04 19:11:37.255064 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 370/721] 10.222.0.69 () {62 vars in 1318 bytes} [Wed May 4 19:11:36 2022] POST /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6/action => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 04 19:11:37.263757 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-3d7f8f03-81ff-4101-ba08-466c6afeae68 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:37.264460 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-3d7f8f03-81ff-4101-ba08-466c6afeae68 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:37.271218 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3d7f8f03-81ff-4101-ba08-466c6afeae68 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:37.271741 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3d7f8f03-81ff-4101-ba08-466c6afeae68 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:37.272553 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3d7f8f03-81ff-4101-ba08-466c6afeae68 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:37.272993 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3d7f8f03-81ff-4101-ba08-466c6afeae68 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:37.404868 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-3d7f8f03-81ff-4101-ba08-466c6afeae68 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:37.413166 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-3d7f8f03-81ff-4101-ba08-466c6afeae68 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:37.414683 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-3d7f8f03-81ff-4101-ba08-466c6afeae68 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:37.415823 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-3d7f8f03-81ff-4101-ba08-466c6afeae68 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1723 microversion: 2.20 time: 0.156499 May 04 19:11:37.416369 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 352/722] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:11:37 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:11:38.436561 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-a8e2f0dc-31f1-40e2-a867-16b332c4654e tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:38.437250 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-a8e2f0dc-31f1-40e2-a867-16b332c4654e tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:38.443641 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a8e2f0dc-31f1-40e2-a867-16b332c4654e tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:38.444087 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a8e2f0dc-31f1-40e2-a867-16b332c4654e tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:38.444876 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a8e2f0dc-31f1-40e2-a867-16b332c4654e tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:38.445314 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a8e2f0dc-31f1-40e2-a867-16b332c4654e tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:38.572176 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-a8e2f0dc-31f1-40e2-a867-16b332c4654e tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:38.579838 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-a8e2f0dc-31f1-40e2-a867-16b332c4654e tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:38.581320 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-a8e2f0dc-31f1-40e2-a867-16b332c4654e tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:38.582513 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-a8e2f0dc-31f1-40e2-a867-16b332c4654e tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1723 microversion: 2.20 time: 0.151437 May 04 19:11:38.583068 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 371/723] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:11:38 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:11:39.600750 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-1f4bd198-4310-476d-8afd-a4df582ff27f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:39.601362 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-1f4bd198-4310-476d-8afd-a4df582ff27f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:39.607752 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1f4bd198-4310-476d-8afd-a4df582ff27f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:39.608200 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1f4bd198-4310-476d-8afd-a4df582ff27f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:39.608958 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1f4bd198-4310-476d-8afd-a4df582ff27f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:39.609394 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1f4bd198-4310-476d-8afd-a4df582ff27f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:39.732046 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-1f4bd198-4310-476d-8afd-a4df582ff27f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:39.739778 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-1f4bd198-4310-476d-8afd-a4df582ff27f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:39.741278 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-1f4bd198-4310-476d-8afd-a4df582ff27f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:39.742457 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-1f4bd198-4310-476d-8afd-a4df582ff27f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1723 microversion: 2.20 time: 0.145642 May 04 19:11:39.743021 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 353/724] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:11:39 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:11:40.760187 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-dd1e4f33-55b2-490b-814d-cce8f2765831 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:40.761281 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-dd1e4f33-55b2-490b-814d-cce8f2765831 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:40.767961 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-dd1e4f33-55b2-490b-814d-cce8f2765831 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:40.768407 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-dd1e4f33-55b2-490b-814d-cce8f2765831 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:40.769175 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-dd1e4f33-55b2-490b-814d-cce8f2765831 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:40.769657 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-dd1e4f33-55b2-490b-814d-cce8f2765831 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:40.896507 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-dd1e4f33-55b2-490b-814d-cce8f2765831 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:40.904725 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-dd1e4f33-55b2-490b-814d-cce8f2765831 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:40.906245 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-dd1e4f33-55b2-490b-814d-cce8f2765831 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:40.907391 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-dd1e4f33-55b2-490b-814d-cce8f2765831 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1723 microversion: 2.20 time: 0.151123 May 04 19:11:40.907943 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 372/725] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:11:40 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:11:41.925007 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-5ee64500-5e0d-4001-bfc1-6a6242795b61 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:41.925636 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-5ee64500-5e0d-4001-bfc1-6a6242795b61 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:41.932032 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5ee64500-5e0d-4001-bfc1-6a6242795b61 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:41.932477 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5ee64500-5e0d-4001-bfc1-6a6242795b61 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:41.933212 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5ee64500-5e0d-4001-bfc1-6a6242795b61 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:41.933677 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5ee64500-5e0d-4001-bfc1-6a6242795b61 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:42.063337 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-5ee64500-5e0d-4001-bfc1-6a6242795b61 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:42.070876 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-5ee64500-5e0d-4001-bfc1-6a6242795b61 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:42.072393 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-5ee64500-5e0d-4001-bfc1-6a6242795b61 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:42.073618 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-5ee64500-5e0d-4001-bfc1-6a6242795b61 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1723 microversion: 2.20 time: 0.152388 May 04 19:11:42.074177 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 354/726] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:11:41 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:11:43.091168 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-8e39c6d2-6888-478e-9c4a-15a9ea077b67 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:43.091777 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-8e39c6d2-6888-478e-9c4a-15a9ea077b67 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:43.098094 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8e39c6d2-6888-478e-9c4a-15a9ea077b67 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:43.098539 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8e39c6d2-6888-478e-9c4a-15a9ea077b67 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:43.099300 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8e39c6d2-6888-478e-9c4a-15a9ea077b67 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:43.099733 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8e39c6d2-6888-478e-9c4a-15a9ea077b67 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:43.224528 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-8e39c6d2-6888-478e-9c4a-15a9ea077b67 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:43.233061 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-8e39c6d2-6888-478e-9c4a-15a9ea077b67 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:43.234525 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-8e39c6d2-6888-478e-9c4a-15a9ea077b67 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:43.235675 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-8e39c6d2-6888-478e-9c4a-15a9ea077b67 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1723 microversion: 2.20 time: 0.148421 May 04 19:11:43.236261 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 373/727] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:11:43 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:11:43.254667 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-76151302-8904-4724-86ab-a32c8232cd1e tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:43.255170 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-76151302-8904-4724-86ab-a32c8232cd1e tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 81874ac9-ec8c-4fb1-bd75-762920f7042d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:43.261309 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-76151302-8904-4724-86ab-a32c8232cd1e tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:43.261786 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-76151302-8904-4724-86ab-a32c8232cd1e tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:43.262549 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-76151302-8904-4724-86ab-a32c8232cd1e tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:43.262986 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-76151302-8904-4724-86ab-a32c8232cd1e tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:43.285510 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-76151302-8904-4724-86ab-a32c8232cd1e tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/81874ac9-ec8c-4fb1-bd75-762920f7042d/ips" status: 200 len: 150 microversion: 2.1 time: 0.034667 May 04 19:11:43.286063 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 355/728] 10.222.0.69 () {58 vars in 1247 bytes} [Wed May 4 19:11:43 2022] GET /compute/v2.1/servers/81874ac9-ec8c-4fb1-bd75-762920f7042d/ips => generated 150 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:11:44.254432 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-8169dff8-b4aa-4462-a66b-9885d5de9a81 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:44.254965 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-8169dff8-b4aa-4462-a66b-9885d5de9a81 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:44.261825 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8169dff8-b4aa-4462-a66b-9885d5de9a81 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:44.262267 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8169dff8-b4aa-4462-a66b-9885d5de9a81 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:44.263015 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8169dff8-b4aa-4462-a66b-9885d5de9a81 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:44.263447 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8169dff8-b4aa-4462-a66b-9885d5de9a81 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:44.392148 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-8169dff8-b4aa-4462-a66b-9885d5de9a81 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:44.399748 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-8169dff8-b4aa-4462-a66b-9885d5de9a81 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:44.401312 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-8169dff8-b4aa-4462-a66b-9885d5de9a81 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:44.402481 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-8169dff8-b4aa-4462-a66b-9885d5de9a81 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1723 microversion: 2.20 time: 0.151994 May 04 19:11:44.403034 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 374/729] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:11:44 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:11:44.590189 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-ace86ca8-d571-4d12-b0bb-aa74cf742cdc tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ee675647-147f-4bbe-842a-a08b9f77ea80"}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:11:44.591296 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-ace86ca8-d571-4d12-b0bb-aa74cf742cdc tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 81874ac9-ec8c-4fb1-bd75-762920f7042d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:44.597554 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ace86ca8-d571-4d12-b0bb-aa74cf742cdc tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:44.598006 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ace86ca8-d571-4d12-b0bb-aa74cf742cdc tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:44.598759 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ace86ca8-d571-4d12-b0bb-aa74cf742cdc tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:44.599195 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ace86ca8-d571-4d12-b0bb-aa74cf742cdc tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:44.860769 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-ace86ca8-d571-4d12-b0bb-aa74cf742cdc tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "POST /compute/v2.1/servers/81874ac9-ec8c-4fb1-bd75-762920f7042d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274274 May 04 19:11:44.861376 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 356/730] 10.222.0.69 () {60 vars in 1322 bytes} [Wed May 4 19:11:44 2022] POST /compute/v2.1/servers/81874ac9-ec8c-4fb1-bd75-762920f7042d/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:11:45.421129 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-3cec5060-d3b8-4109-b748-e8b0c2d50b52 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:45.422228 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-3cec5060-d3b8-4109-b748-e8b0c2d50b52 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:45.429582 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3cec5060-d3b8-4109-b748-e8b0c2d50b52 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:45.430092 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3cec5060-d3b8-4109-b748-e8b0c2d50b52 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:45.430862 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3cec5060-d3b8-4109-b748-e8b0c2d50b52 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:45.431301 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3cec5060-d3b8-4109-b748-e8b0c2d50b52 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:45.558328 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-3cec5060-d3b8-4109-b748-e8b0c2d50b52 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:45.566218 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-3cec5060-d3b8-4109-b748-e8b0c2d50b52 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:45.567710 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-3cec5060-d3b8-4109-b748-e8b0c2d50b52 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:45.568914 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-3cec5060-d3b8-4109-b748-e8b0c2d50b52 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1723 microversion: 2.20 time: 0.153142 May 04 19:11:45.569473 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 375/731] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:11:45 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:11:46.589537 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-d7de7e98-0d83-46bc-ab2a-ac7e8d574de8 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:46.590223 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-d7de7e98-0d83-46bc-ab2a-ac7e8d574de8 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:46.596274 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d7de7e98-0d83-46bc-ab2a-ac7e8d574de8 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:46.596715 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d7de7e98-0d83-46bc-ab2a-ac7e8d574de8 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:46.597484 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d7de7e98-0d83-46bc-ab2a-ac7e8d574de8 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:46.597922 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d7de7e98-0d83-46bc-ab2a-ac7e8d574de8 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:46.723236 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-d7de7e98-0d83-46bc-ab2a-ac7e8d574de8 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:46.730860 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-d7de7e98-0d83-46bc-ab2a-ac7e8d574de8 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:46.732347 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-d7de7e98-0d83-46bc-ab2a-ac7e8d574de8 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:46.733500 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-d7de7e98-0d83-46bc-ab2a-ac7e8d574de8 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1723 microversion: 2.20 time: 0.149131 May 04 19:11:46.734054 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 357/732] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:11:46 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:11:47.751977 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-ad80c64a-906f-49b5-984e-fab4f125bf72 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:47.752578 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-ad80c64a-906f-49b5-984e-fab4f125bf72 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:47.758845 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ad80c64a-906f-49b5-984e-fab4f125bf72 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:47.759292 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ad80c64a-906f-49b5-984e-fab4f125bf72 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:47.760046 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ad80c64a-906f-49b5-984e-fab4f125bf72 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:47.760476 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ad80c64a-906f-49b5-984e-fab4f125bf72 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:47.882670 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-ad80c64a-906f-49b5-984e-fab4f125bf72 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:47.890220 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-ad80c64a-906f-49b5-984e-fab4f125bf72 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:47.891993 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-ad80c64a-906f-49b5-984e-fab4f125bf72 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:47.893126 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-ad80c64a-906f-49b5-984e-fab4f125bf72 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1723 microversion: 2.20 time: 0.145006 May 04 19:11:47.893705 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 376/733] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:11:47 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1723 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:11:48.911211 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-82d42027-caf1-481e-801d-92398b3a231d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:48.911817 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-82d42027-caf1-481e-801d-92398b3a231d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:48.918642 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-82d42027-caf1-481e-801d-92398b3a231d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:48.919087 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-82d42027-caf1-481e-801d-92398b3a231d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:48.919840 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-82d42027-caf1-481e-801d-92398b3a231d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:48.920272 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-82d42027-caf1-481e-801d-92398b3a231d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:49.043997 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-82d42027-caf1-481e-801d-92398b3a231d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:49.051660 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-82d42027-caf1-481e-801d-92398b3a231d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:49.053157 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-82d42027-caf1-481e-801d-92398b3a231d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:49.054341 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-82d42027-caf1-481e-801d-92398b3a231d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1723 microversion: 2.20 time: 0.147037 May 04 19:11:49.054937 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 358/734] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:11:48 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:11:50.072926 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-ff78154f-35d7-4296-b98d-b73901a87f09 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:50.074135 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-ff78154f-35d7-4296-b98d-b73901a87f09 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:50.080546 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ff78154f-35d7-4296-b98d-b73901a87f09 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:50.080999 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ff78154f-35d7-4296-b98d-b73901a87f09 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:50.081812 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ff78154f-35d7-4296-b98d-b73901a87f09 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:50.082263 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ff78154f-35d7-4296-b98d-b73901a87f09 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:50.209808 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-ff78154f-35d7-4296-b98d-b73901a87f09 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:50.217439 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-ff78154f-35d7-4296-b98d-b73901a87f09 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:50.218957 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-ff78154f-35d7-4296-b98d-b73901a87f09 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:50.220111 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-ff78154f-35d7-4296-b98d-b73901a87f09 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1723 microversion: 2.20 time: 0.151107 May 04 19:11:50.220707 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 377/735] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:11:50 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:11:51.237187 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-10818ce6-3380-49bf-a2be-c20987673823 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:51.237764 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-10818ce6-3380-49bf-a2be-c20987673823 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:51.244066 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-10818ce6-3380-49bf-a2be-c20987673823 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:51.244514 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-10818ce6-3380-49bf-a2be-c20987673823 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:51.245282 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-10818ce6-3380-49bf-a2be-c20987673823 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:51.245756 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-10818ce6-3380-49bf-a2be-c20987673823 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:51.378816 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-10818ce6-3380-49bf-a2be-c20987673823 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:51.387186 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-10818ce6-3380-49bf-a2be-c20987673823 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:51.388691 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-10818ce6-3380-49bf-a2be-c20987673823 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:51.389874 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-10818ce6-3380-49bf-a2be-c20987673823 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1723 microversion: 2.20 time: 0.156638 May 04 19:11:51.390435 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 359/736] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:11:51 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:11:51.622464 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-e38f5e24-a807-4c58-ac95-470692b7e92a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:51.622974 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-e38f5e24-a807-4c58-ac95-470692b7e92a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:51.629286 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e38f5e24-a807-4c58-ac95-470692b7e92a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:51.629768 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e38f5e24-a807-4c58-ac95-470692b7e92a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:51.630518 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e38f5e24-a807-4c58-ac95-470692b7e92a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:51.630950 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e38f5e24-a807-4c58-ac95-470692b7e92a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:51.711419 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.objects.instance [None req-e38f5e24-a807-4c58-ac95-470692b7e92a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lazy-loading 'services' on Instance uuid 17de0a81-ab42-475e-b6f3-dd853adc826c {{(pid=117124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 04 19:11:51.783986 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-e38f5e24-a807-4c58-ac95-470692b7e92a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "DELETE /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c/os-volume_attachments/70f7367c-249b-4a7d-8b81-9cc0d2c5d772" status: 202 len: 0 microversion: 2.1 time: 0.165650 May 04 19:11:51.784900 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 378/737] 10.222.0.69 () {58 vars in 1415 bytes} [Wed May 4 19:11:51 2022] DELETE /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c/os-volume_attachments/70f7367c-249b-4a7d-8b81-9cc0d2c5d772 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 04 19:11:51.793425 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-ffec5053-8494-4ac2-8414-5b1f4567cce5 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:51.794398 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-ffec5053-8494-4ac2-8414-5b1f4567cce5 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:51.800405 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ffec5053-8494-4ac2-8414-5b1f4567cce5 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:51.800923 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ffec5053-8494-4ac2-8414-5b1f4567cce5 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:51.801869 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ffec5053-8494-4ac2-8414-5b1f4567cce5 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:51.802341 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ffec5053-8494-4ac2-8414-5b1f4567cce5 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:51.833885 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-ffec5053-8494-4ac2-8414-5b1f4567cce5 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044730 May 04 19:11:51.834458 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 360/738] 10.222.0.69 () {58 vars in 1301 bytes} [Wed May 4 19:11:51 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:11:52.319888 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-ad9d1db1-8a47-4eab-9fe7-e58d35db34ad tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ee675647-147f-4bbe-842a-a08b9f77ea80"}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:11:52.321083 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-ad9d1db1-8a47-4eab-9fe7-e58d35db34ad tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 81874ac9-ec8c-4fb1-bd75-762920f7042d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:52.327170 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ad9d1db1-8a47-4eab-9fe7-e58d35db34ad tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:52.327616 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ad9d1db1-8a47-4eab-9fe7-e58d35db34ad tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:52.328373 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ad9d1db1-8a47-4eab-9fe7-e58d35db34ad tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:52.328808 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ad9d1db1-8a47-4eab-9fe7-e58d35db34ad tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:52.405439 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.wsgi [None req-ad9d1db1-8a47-4eab-9fe7-e58d35db34ad tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] HTTP exception thrown: Invalid volume: volume ee675647-147f-4bbe-842a-a08b9f77ea80 is already attached to instances: 81874ac9-ec8c-4fb1-bd75-762920f7042d May 04 19:11:52.406068 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-ad9d1db1-8a47-4eab-9fe7-e58d35db34ad tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Returning 400 to user: Invalid volume: volume ee675647-147f-4bbe-842a-a08b9f77ea80 is already attached to instances: 81874ac9-ec8c-4fb1-bd75-762920f7042d {{(pid=117124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 04 19:11:52.406910 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-ad9d1db1-8a47-4eab-9fe7-e58d35db34ad tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "POST /compute/v2.1/servers/81874ac9-ec8c-4fb1-bd75-762920f7042d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.091473 May 04 19:11:52.407511 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 379/739] 10.222.0.69 () {60 vars in 1322 bytes} [Wed May 4 19:11:52 2022] POST /compute/v2.1/servers/81874ac9-ec8c-4fb1-bd75-762920f7042d/os-volume_attachments => generated 174 bytes in 93 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 04 19:11:52.408271 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-489c7d48-3eac-4621-b397-cc8a4763d880 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:52.408873 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-489c7d48-3eac-4621-b397-cc8a4763d880 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:52.415369 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-489c7d48-3eac-4621-b397-cc8a4763d880 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:52.415817 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-489c7d48-3eac-4621-b397-cc8a4763d880 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:52.416582 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-489c7d48-3eac-4621-b397-cc8a4763d880 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:52.417700 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-489c7d48-3eac-4621-b397-cc8a4763d880 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:52.482179 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-d48e4343-34d5-4078-af43-df0e160ed914 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:52.482617 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-d48e4343-34d5-4078-af43-df0e160ed914 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 81874ac9-ec8c-4fb1-bd75-762920f7042d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:52.490167 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d48e4343-34d5-4078-af43-df0e160ed914 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:52.490636 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d48e4343-34d5-4078-af43-df0e160ed914 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:52.491388 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d48e4343-34d5-4078-af43-df0e160ed914 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:52.491867 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d48e4343-34d5-4078-af43-df0e160ed914 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:52.564013 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-489c7d48-3eac-4621-b397-cc8a4763d880 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:52.572625 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-489c7d48-3eac-4621-b397-cc8a4763d880 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:52.574273 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-489c7d48-3eac-4621-b397-cc8a4763d880 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:52.575497 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-489c7d48-3eac-4621-b397-cc8a4763d880 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1723 microversion: 2.20 time: 0.171238 May 04 19:11:52.576159 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 361/740] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:11:52 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 04 19:11:52.576810 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.objects.instance [None req-d48e4343-34d5-4078-af43-df0e160ed914 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lazy-loading 'services' on Instance uuid 81874ac9-ec8c-4fb1-bd75-762920f7042d {{(pid=117124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 04 19:11:52.647909 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-d48e4343-34d5-4078-af43-df0e160ed914 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "DELETE /compute/v2.1/servers/81874ac9-ec8c-4fb1-bd75-762920f7042d/os-volume_attachments/ee675647-147f-4bbe-842a-a08b9f77ea80" status: 202 len: 0 microversion: 2.1 time: 0.171283 May 04 19:11:52.648605 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 380/741] 10.222.0.69 () {58 vars in 1415 bytes} [Wed May 4 19:11:52 2022] DELETE /compute/v2.1/servers/81874ac9-ec8c-4fb1-bd75-762920f7042d/os-volume_attachments/ee675647-147f-4bbe-842a-a08b9f77ea80 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 04 19:11:52.657228 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-50d1c74d-4aae-47f5-b9ff-329a8b4088bd tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:52.658176 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-50d1c74d-4aae-47f5-b9ff-329a8b4088bd tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 81874ac9-ec8c-4fb1-bd75-762920f7042d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:52.664084 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-50d1c74d-4aae-47f5-b9ff-329a8b4088bd tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:52.664541 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-50d1c74d-4aae-47f5-b9ff-329a8b4088bd tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:52.665304 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-50d1c74d-4aae-47f5-b9ff-329a8b4088bd tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:52.665955 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-50d1c74d-4aae-47f5-b9ff-329a8b4088bd tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:52.695208 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-50d1c74d-4aae-47f5-b9ff-329a8b4088bd tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/81874ac9-ec8c-4fb1-bd75-762920f7042d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041738 May 04 19:11:52.695754 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 362/742] 10.222.0.69 () {58 vars in 1301 bytes} [Wed May 4 19:11:52 2022] GET /compute/v2.1/servers/81874ac9-ec8c-4fb1-bd75-762920f7042d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:11:52.851039 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-7285163e-58e2-4987-b4e7-70d2456ddbad tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:52.853682 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-7285163e-58e2-4987-b4e7-70d2456ddbad tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:52.862037 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7285163e-58e2-4987-b4e7-70d2456ddbad tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:52.862488 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7285163e-58e2-4987-b4e7-70d2456ddbad tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:52.863271 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7285163e-58e2-4987-b4e7-70d2456ddbad tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:52.863711 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7285163e-58e2-4987-b4e7-70d2456ddbad tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:52.903073 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-7285163e-58e2-4987-b4e7-70d2456ddbad tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057109 May 04 19:11:52.903815 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 381/743] 10.222.0.69 () {58 vars in 1301 bytes} [Wed May 4 19:11:52 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:11:53.594147 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-660d6ea0-49cc-4a74-867e-72b414ac4352 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:53.594749 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-660d6ea0-49cc-4a74-867e-72b414ac4352 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:53.600967 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-660d6ea0-49cc-4a74-867e-72b414ac4352 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:53.601406 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-660d6ea0-49cc-4a74-867e-72b414ac4352 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:53.602192 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-660d6ea0-49cc-4a74-867e-72b414ac4352 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:53.602624 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-660d6ea0-49cc-4a74-867e-72b414ac4352 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:53.707276 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-e65dd260-c612-4908-832d-f77b5fecc435 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:53.708198 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-e65dd260-c612-4908-832d-f77b5fecc435 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 81874ac9-ec8c-4fb1-bd75-762920f7042d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:53.714400 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e65dd260-c612-4908-832d-f77b5fecc435 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:53.714846 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e65dd260-c612-4908-832d-f77b5fecc435 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:53.715610 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e65dd260-c612-4908-832d-f77b5fecc435 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:53.716046 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e65dd260-c612-4908-832d-f77b5fecc435 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:53.730304 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-660d6ea0-49cc-4a74-867e-72b414ac4352 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:53.739087 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-660d6ea0-49cc-4a74-867e-72b414ac4352 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:53.740579 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-660d6ea0-49cc-4a74-867e-72b414ac4352 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:53.741772 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-660d6ea0-49cc-4a74-867e-72b414ac4352 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1744 microversion: 2.20 time: 0.151407 May 04 19:11:53.742321 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 363/744] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:11:53 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1744 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:11:53.746388 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-e65dd260-c612-4908-832d-f77b5fecc435 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/81874ac9-ec8c-4fb1-bd75-762920f7042d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042906 May 04 19:11:53.747128 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 382/745] 10.222.0.69 () {58 vars in 1301 bytes} [Wed May 4 19:11:53 2022] GET /compute/v2.1/servers/81874ac9-ec8c-4fb1-bd75-762920f7042d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 04 19:11:53.915347 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-e227b499-11d2-4b54-a775-4e33e81a9522 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:53.916275 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-e227b499-11d2-4b54-a775-4e33e81a9522 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:53.922760 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e227b499-11d2-4b54-a775-4e33e81a9522 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:53.923220 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e227b499-11d2-4b54-a775-4e33e81a9522 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:53.924019 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e227b499-11d2-4b54-a775-4e33e81a9522 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:53.924461 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e227b499-11d2-4b54-a775-4e33e81a9522 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:53.953065 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-e227b499-11d2-4b54-a775-4e33e81a9522 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041689 May 04 19:11:53.953672 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 364/746] 10.222.0.69 () {58 vars in 1301 bytes} [Wed May 4 19:11:53 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 04 19:11:54.036142 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-7bf48f30-087b-4296-99d9-e25499704ccd tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:54.036718 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-7bf48f30-087b-4296-99d9-e25499704ccd tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:54.043223 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7bf48f30-087b-4296-99d9-e25499704ccd tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:54.043744 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7bf48f30-087b-4296-99d9-e25499704ccd tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:54.044640 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7bf48f30-087b-4296-99d9-e25499704ccd tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:54.045166 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7bf48f30-087b-4296-99d9-e25499704ccd tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:54.069586 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-7bf48f30-087b-4296-99d9-e25499704ccd tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Going to try to terminate instance {{(pid=117124) delete /opt/stack/nova/nova/compute/api.py:2664}} May 04 19:11:54.145186 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-7bf48f30-087b-4296-99d9-e25499704ccd tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "DELETE /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 204 len: 0 microversion: 2.1 time: 0.112742 May 04 19:11:54.145810 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 383/747] 10.222.0.69 () {58 vars in 1238 bytes} [Wed May 4 19:11:54 2022] DELETE /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 04 19:11:54.154463 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-7e9c92b6-511d-432f-877c-1e5ded732dea tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:54.155208 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-7e9c92b6-511d-432f-877c-1e5ded732dea tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:54.162858 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7e9c92b6-511d-432f-877c-1e5ded732dea tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:54.163559 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7e9c92b6-511d-432f-877c-1e5ded732dea tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:54.164401 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7e9c92b6-511d-432f-877c-1e5ded732dea tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:54.164904 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7e9c92b6-511d-432f-877c-1e5ded732dea tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:54.290439 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-7e9c92b6-511d-432f-877c-1e5ded732dea tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:54.297924 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-7e9c92b6-511d-432f-877c-1e5ded732dea tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 200 len: 1689 microversion: 2.1 time: 0.147798 May 04 19:11:54.298495 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 365/748] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:11:54 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 1689 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:11:54.758806 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-1ba2157e-88d3-48ac-8286-7ec6dc01ce91 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:54.759809 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-1ba2157e-88d3-48ac-8286-7ec6dc01ce91 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 81874ac9-ec8c-4fb1-bd75-762920f7042d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:54.759917 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-35d52c20-151f-45bc-bcff-347757a4f2e5 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:54.762758 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-35d52c20-151f-45bc-bcff-347757a4f2e5 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:54.767228 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1ba2157e-88d3-48ac-8286-7ec6dc01ce91 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:54.767679 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1ba2157e-88d3-48ac-8286-7ec6dc01ce91 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:54.767857 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-35d52c20-151f-45bc-bcff-347757a4f2e5 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:54.768313 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-35d52c20-151f-45bc-bcff-347757a4f2e5 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:54.768437 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1ba2157e-88d3-48ac-8286-7ec6dc01ce91 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:54.768871 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1ba2157e-88d3-48ac-8286-7ec6dc01ce91 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:54.769078 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-35d52c20-151f-45bc-bcff-347757a4f2e5 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:54.769541 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-35d52c20-151f-45bc-bcff-347757a4f2e5 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:54.797367 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-1ba2157e-88d3-48ac-8286-7ec6dc01ce91 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/81874ac9-ec8c-4fb1-bd75-762920f7042d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042908 May 04 19:11:54.798546 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 384/749] 10.222.0.69 () {58 vars in 1301 bytes} [Wed May 4 19:11:54 2022] GET /compute/v2.1/servers/81874ac9-ec8c-4fb1-bd75-762920f7042d/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 04 19:11:54.856096 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-bec7695f-dd3f-43fa-a433-8c7bf54de796 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:54.856588 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-bec7695f-dd3f-43fa-a433-8c7bf54de796 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 81874ac9-ec8c-4fb1-bd75-762920f7042d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:54.862551 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-bec7695f-dd3f-43fa-a433-8c7bf54de796 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:54.862998 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-bec7695f-dd3f-43fa-a433-8c7bf54de796 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:54.863794 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-bec7695f-dd3f-43fa-a433-8c7bf54de796 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:54.864258 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-bec7695f-dd3f-43fa-a433-8c7bf54de796 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:54.889938 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-bec7695f-dd3f-43fa-a433-8c7bf54de796 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 81874ac9-ec8c-4fb1-bd75-762920f7042d] Going to try to terminate instance {{(pid=117124) delete /opt/stack/nova/nova/compute/api.py:2664}} May 04 19:11:54.897871 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-35d52c20-151f-45bc-bcff-347757a4f2e5 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:54.905635 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-35d52c20-151f-45bc-bcff-347757a4f2e5 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:54.907122 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-35d52c20-151f-45bc-bcff-347757a4f2e5 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:54.908305 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-35d52c20-151f-45bc-bcff-347757a4f2e5 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1744 microversion: 2.20 time: 0.152232 May 04 19:11:54.909106 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 366/750] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:11:54 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 04 19:11:54.963314 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-bec7695f-dd3f-43fa-a433-8c7bf54de796 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "DELETE /compute/v2.1/servers/81874ac9-ec8c-4fb1-bd75-762920f7042d" status: 204 len: 0 microversion: 2.1 time: 0.110755 May 04 19:11:54.963894 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 385/751] 10.222.0.69 () {58 vars in 1238 bytes} [Wed May 4 19:11:54 2022] DELETE /compute/v2.1/servers/81874ac9-ec8c-4fb1-bd75-762920f7042d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 04 19:11:54.972104 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-01132cc4-e954-4b34-94fd-092f15c3051f tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:54.972936 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-01132cc4-e954-4b34-94fd-092f15c3051f tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 81874ac9-ec8c-4fb1-bd75-762920f7042d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:54.978905 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-01132cc4-e954-4b34-94fd-092f15c3051f tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:54.980169 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-01132cc4-e954-4b34-94fd-092f15c3051f tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:54.980927 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-01132cc4-e954-4b34-94fd-092f15c3051f tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:54.981368 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-01132cc4-e954-4b34-94fd-092f15c3051f tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:55.107458 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-01132cc4-e954-4b34-94fd-092f15c3051f tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:55.114628 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-01132cc4-e954-4b34-94fd-092f15c3051f tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/81874ac9-ec8c-4fb1-bd75-762920f7042d" status: 200 len: 1682 microversion: 2.1 time: 0.146479 May 04 19:11:55.115193 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 367/752] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:11:54 2022] GET /compute/v2.1/servers/81874ac9-ec8c-4fb1-bd75-762920f7042d => generated 1682 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:11:55.315665 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-187da2bd-f6f6-4d58-b8dc-946bfae21b7b tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:55.316295 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-187da2bd-f6f6-4d58-b8dc-946bfae21b7b tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:55.322126 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-187da2bd-f6f6-4d58-b8dc-946bfae21b7b tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:55.322576 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-187da2bd-f6f6-4d58-b8dc-946bfae21b7b tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:55.323336 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-187da2bd-f6f6-4d58-b8dc-946bfae21b7b tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:55.323770 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-187da2bd-f6f6-4d58-b8dc-946bfae21b7b tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:55.447804 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-187da2bd-f6f6-4d58-b8dc-946bfae21b7b tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:55.455206 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-187da2bd-f6f6-4d58-b8dc-946bfae21b7b tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 200 len: 1689 microversion: 2.1 time: 0.143764 May 04 19:11:55.455786 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 386/753] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:11:55 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 1689 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:11:55.927116 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-d47d494d-476e-4f6b-8e81-a52ed89a32fc tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:55.928092 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-d47d494d-476e-4f6b-8e81-a52ed89a32fc tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:55.935048 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d47d494d-476e-4f6b-8e81-a52ed89a32fc tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:55.935497 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d47d494d-476e-4f6b-8e81-a52ed89a32fc tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:55.936289 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d47d494d-476e-4f6b-8e81-a52ed89a32fc tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:55.936735 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d47d494d-476e-4f6b-8e81-a52ed89a32fc tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:56.062924 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-d47d494d-476e-4f6b-8e81-a52ed89a32fc tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:56.070629 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-d47d494d-476e-4f6b-8e81-a52ed89a32fc tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:56.072120 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-d47d494d-476e-4f6b-8e81-a52ed89a32fc tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:56.073910 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-d47d494d-476e-4f6b-8e81-a52ed89a32fc tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1744 microversion: 2.20 time: 0.150077 May 04 19:11:56.074469 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 368/754] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:11:55 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1744 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:11:56.132212 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-df24014c-fa16-4ecd-bfa1-968830f1167b tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:56.132849 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-df24014c-fa16-4ecd-bfa1-968830f1167b tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 81874ac9-ec8c-4fb1-bd75-762920f7042d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:56.139507 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-df24014c-fa16-4ecd-bfa1-968830f1167b tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:56.139958 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-df24014c-fa16-4ecd-bfa1-968830f1167b tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:56.140745 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-df24014c-fa16-4ecd-bfa1-968830f1167b tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:56.141144 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-df24014c-fa16-4ecd-bfa1-968830f1167b tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:56.147113 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-c1afb2bc-814b-4743-9495-5927732b1fa3 req-da0d013c-804a-47d9-a62b-bead35528a7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc9f6260-f308-4f45-809e-40f50eeb47d6", "name": "network-vif-plugged", "status": "completed", "tag": "7d596d4a-07a6-43a1-bc43-abfd6db7c370"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:11:56.155787 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-c1afb2bc-814b-4743-9495-5927732b1fa3 req-da0d013c-804a-47d9-a62b-bead35528a7b service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:56.156306 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-c1afb2bc-814b-4743-9495-5927732b1fa3 req-da0d013c-804a-47d9-a62b-bead35528a7b service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:56.167303 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-c1afb2bc-814b-4743-9495-5927732b1fa3 req-da0d013c-804a-47d9-a62b-bead35528a7b service nova] Creating event network-vif-plugged:7d596d4a-07a6-43a1-bc43-abfd6db7c370 for instance bc9f6260-f308-4f45-809e-40f50eeb47d6 on hv-cinder-83090 May 04 19:11:56.172383 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-c1afb2bc-814b-4743-9495-5927732b1fa3 req-da0d013c-804a-47d9-a62b-bead35528a7b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088710 May 04 19:11:56.173058 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 387/755] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 04 19:11:56.273695 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-df24014c-fa16-4ecd-bfa1-968830f1167b tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:56.280914 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-df24014c-fa16-4ecd-bfa1-968830f1167b tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/81874ac9-ec8c-4fb1-bd75-762920f7042d" status: 200 len: 1682 microversion: 2.1 time: 0.152773 May 04 19:11:56.281489 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 369/756] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:11:56 2022] GET /compute/v2.1/servers/81874ac9-ec8c-4fb1-bd75-762920f7042d => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:11:56.472520 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-b46b2edc-6e24-4773-b4c9-4d29395de85e tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:56.473219 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-b46b2edc-6e24-4773-b4c9-4d29395de85e tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:56.479921 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b46b2edc-6e24-4773-b4c9-4d29395de85e tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:56.480308 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b46b2edc-6e24-4773-b4c9-4d29395de85e tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:56.481068 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b46b2edc-6e24-4773-b4c9-4d29395de85e tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:56.481532 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b46b2edc-6e24-4773-b4c9-4d29395de85e tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:56.609630 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-b46b2edc-6e24-4773-b4c9-4d29395de85e tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:56.616833 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-b46b2edc-6e24-4773-b4c9-4d29395de85e tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 200 len: 1689 microversion: 2.1 time: 0.148478 May 04 19:11:56.617400 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 388/757] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:11:56 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 1689 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:11:57.092206 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-41cfc135-b067-41c6-967d-9ad701bfeeea tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:57.092820 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-41cfc135-b067-41c6-967d-9ad701bfeeea tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:57.099461 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-41cfc135-b067-41c6-967d-9ad701bfeeea tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:57.099907 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-41cfc135-b067-41c6-967d-9ad701bfeeea tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:57.100662 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-41cfc135-b067-41c6-967d-9ad701bfeeea tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:57.101092 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-41cfc135-b067-41c6-967d-9ad701bfeeea tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:57.225541 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-41cfc135-b067-41c6-967d-9ad701bfeeea tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:57.233066 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-41cfc135-b067-41c6-967d-9ad701bfeeea tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:57.234586 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-41cfc135-b067-41c6-967d-9ad701bfeeea tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:57.235722 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-41cfc135-b067-41c6-967d-9ad701bfeeea tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1744 microversion: 2.20 time: 0.147915 May 04 19:11:57.236308 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 370/758] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:11:57 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1744 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:11:57.297717 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-163f89f8-d27c-4935-972a-7172ede5a34d tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:57.298320 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-163f89f8-d27c-4935-972a-7172ede5a34d tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 81874ac9-ec8c-4fb1-bd75-762920f7042d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:57.304036 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-163f89f8-d27c-4935-972a-7172ede5a34d tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:57.304479 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-163f89f8-d27c-4935-972a-7172ede5a34d tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:57.305231 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-163f89f8-d27c-4935-972a-7172ede5a34d tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:57.305696 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-163f89f8-d27c-4935-972a-7172ede5a34d tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:57.427426 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-163f89f8-d27c-4935-972a-7172ede5a34d tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:57.434709 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-163f89f8-d27c-4935-972a-7172ede5a34d tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/81874ac9-ec8c-4fb1-bd75-762920f7042d" status: 200 len: 1682 microversion: 2.1 time: 0.140941 May 04 19:11:57.435271 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 389/759] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:11:57 2022] GET /compute/v2.1/servers/81874ac9-ec8c-4fb1-bd75-762920f7042d => generated 1682 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:11:57.634392 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-53d9c0f0-1c20-40d3-8a34-a0927a5c7dfb tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:57.634995 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-53d9c0f0-1c20-40d3-8a34-a0927a5c7dfb tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:57.641699 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-53d9c0f0-1c20-40d3-8a34-a0927a5c7dfb tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:57.642145 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-53d9c0f0-1c20-40d3-8a34-a0927a5c7dfb tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:57.642893 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-53d9c0f0-1c20-40d3-8a34-a0927a5c7dfb tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:57.643321 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-53d9c0f0-1c20-40d3-8a34-a0927a5c7dfb tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:57.768969 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-53d9c0f0-1c20-40d3-8a34-a0927a5c7dfb tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:57.776123 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-53d9c0f0-1c20-40d3-8a34-a0927a5c7dfb tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 200 len: 1689 microversion: 2.1 time: 0.145575 May 04 19:11:57.776692 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 371/760] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:11:57 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 1689 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:11:57.997972 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-b4493557-d404-4ab3-a4fc-ccbb05a2caea tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:57.998458 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-b4493557-d404-4ab3-a4fc-ccbb05a2caea tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: c0ca0b46-570c-45ff-820a-87a4197033f3] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:58.004288 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b4493557-d404-4ab3-a4fc-ccbb05a2caea tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:58.004739 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b4493557-d404-4ab3-a4fc-ccbb05a2caea tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:58.005523 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b4493557-d404-4ab3-a4fc-ccbb05a2caea tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:58.005958 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b4493557-d404-4ab3-a4fc-ccbb05a2caea tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:58.028174 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-b4493557-d404-4ab3-a4fc-ccbb05a2caea tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/c0ca0b46-570c-45ff-820a-87a4197033f3/ips" status: 200 len: 147 microversion: 2.1 time: 0.083401 May 04 19:11:58.028722 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 390/761] 10.222.0.69 () {58 vars in 1247 bytes} [Wed May 4 19:11:57 2022] GET /compute/v2.1/servers/c0ca0b46-570c-45ff-820a-87a4197033f3/ips => generated 147 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:11:58.253589 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-a2f5541c-5232-43f7-81c7-fb12d03c00e8 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:58.254317 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-a2f5541c-5232-43f7-81c7-fb12d03c00e8 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:58.260884 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a2f5541c-5232-43f7-81c7-fb12d03c00e8 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:58.261334 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a2f5541c-5232-43f7-81c7-fb12d03c00e8 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:58.262124 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a2f5541c-5232-43f7-81c7-fb12d03c00e8 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:58.262558 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a2f5541c-5232-43f7-81c7-fb12d03c00e8 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:58.391678 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-a2f5541c-5232-43f7-81c7-fb12d03c00e8 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:58.399370 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-a2f5541c-5232-43f7-81c7-fb12d03c00e8 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:58.400891 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-a2f5541c-5232-43f7-81c7-fb12d03c00e8 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:58.402576 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-a2f5541c-5232-43f7-81c7-fb12d03c00e8 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1744 microversion: 2.20 time: 0.152974 May 04 19:11:58.403141 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 372/762] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:11:58 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:11:58.451554 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-57d92170-cd01-47be-a076-54e4a9a6ec81 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:58.452168 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-57d92170-cd01-47be-a076-54e4a9a6ec81 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 81874ac9-ec8c-4fb1-bd75-762920f7042d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:58.458406 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-57d92170-cd01-47be-a076-54e4a9a6ec81 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:58.458857 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-57d92170-cd01-47be-a076-54e4a9a6ec81 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:58.459616 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-57d92170-cd01-47be-a076-54e4a9a6ec81 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:58.460050 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-57d92170-cd01-47be-a076-54e4a9a6ec81 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:58.608209 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-57d92170-cd01-47be-a076-54e4a9a6ec81 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:58.615582 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-57d92170-cd01-47be-a076-54e4a9a6ec81 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/81874ac9-ec8c-4fb1-bd75-762920f7042d" status: 200 len: 1682 microversion: 2.1 time: 0.167813 May 04 19:11:58.616151 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 391/763] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:11:58 2022] GET /compute/v2.1/servers/81874ac9-ec8c-4fb1-bd75-762920f7042d => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:11:58.793210 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-c628bca3-b85e-4158-8cfb-a4e6858ce071 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:58.793892 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-c628bca3-b85e-4158-8cfb-a4e6858ce071 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:58.799622 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c628bca3-b85e-4158-8cfb-a4e6858ce071 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:58.800067 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c628bca3-b85e-4158-8cfb-a4e6858ce071 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:58.800818 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c628bca3-b85e-4158-8cfb-a4e6858ce071 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:58.801253 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c628bca3-b85e-4158-8cfb-a4e6858ce071 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:58.935396 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-c628bca3-b85e-4158-8cfb-a4e6858ce071 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:58.942726 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-c628bca3-b85e-4158-8cfb-a4e6858ce071 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 200 len: 1689 microversion: 2.1 time: 0.153445 May 04 19:11:58.943283 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 373/764] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:11:58 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 1689 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:11:59.329966 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-f8f2b5d7-1ec2-46ee-97ab-20b3c1753381 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "06ed7258-b5fb-4dff-b0b5-58098a97e74d"}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:11:59.331078 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-f8f2b5d7-1ec2-46ee-97ab-20b3c1753381 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: c0ca0b46-570c-45ff-820a-87a4197033f3] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:59.336816 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f8f2b5d7-1ec2-46ee-97ab-20b3c1753381 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:59.337263 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f8f2b5d7-1ec2-46ee-97ab-20b3c1753381 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:59.338046 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f8f2b5d7-1ec2-46ee-97ab-20b3c1753381 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:59.338502 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f8f2b5d7-1ec2-46ee-97ab-20b3c1753381 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:59.422244 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-18d84c43-f92b-4aca-95fa-1d0571b12141 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:59.422844 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-18d84c43-f92b-4aca-95fa-1d0571b12141 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:59.429099 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-18d84c43-f92b-4aca-95fa-1d0571b12141 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:59.429579 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-18d84c43-f92b-4aca-95fa-1d0571b12141 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:59.430330 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-18d84c43-f92b-4aca-95fa-1d0571b12141 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:59.430761 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-18d84c43-f92b-4aca-95fa-1d0571b12141 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:59.560695 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-18d84c43-f92b-4aca-95fa-1d0571b12141 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:59.568378 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-18d84c43-f92b-4aca-95fa-1d0571b12141 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:59.569911 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-18d84c43-f92b-4aca-95fa-1d0571b12141 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:59.571072 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-18d84c43-f92b-4aca-95fa-1d0571b12141 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1744 microversion: 2.20 time: 0.152741 May 04 19:11:59.571638 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 374/765] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:11:59 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 04 19:11:59.631578 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-4af7be8d-c7c6-495b-89e4-d2e8729f1e92 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:59.632181 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-4af7be8d-c7c6-495b-89e4-d2e8729f1e92 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 81874ac9-ec8c-4fb1-bd75-762920f7042d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:59.637826 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4af7be8d-c7c6-495b-89e4-d2e8729f1e92 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:59.638267 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4af7be8d-c7c6-495b-89e4-d2e8729f1e92 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:59.639017 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4af7be8d-c7c6-495b-89e4-d2e8729f1e92 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:59.639444 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4af7be8d-c7c6-495b-89e4-d2e8729f1e92 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:59.805702 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-4af7be8d-c7c6-495b-89e4-d2e8729f1e92 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:11:59.813304 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-4af7be8d-c7c6-495b-89e4-d2e8729f1e92 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/81874ac9-ec8c-4fb1-bd75-762920f7042d" status: 200 len: 1682 microversion: 2.1 time: 0.185166 May 04 19:11:59.823500 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 375/766] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:11:59 2022] GET /compute/v2.1/servers/81874ac9-ec8c-4fb1-bd75-762920f7042d => generated 1682 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:11:59.960992 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-043a01d8-992b-4b15-a066-8608795acf85 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:11:59.961630 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-043a01d8-992b-4b15-a066-8608795acf85 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:11:59.972751 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-043a01d8-992b-4b15-a066-8608795acf85 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:59.973186 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-043a01d8-992b-4b15-a066-8608795acf85 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:59.974012 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-043a01d8-992b-4b15-a066-8608795acf85 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:11:59.974906 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-043a01d8-992b-4b15-a066-8608795acf85 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:11:59.993052 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-f8f2b5d7-1ec2-46ee-97ab-20b3c1753381 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "POST /compute/v2.1/servers/c0ca0b46-570c-45ff-820a-87a4197033f3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.665575 May 04 19:12:00.000337 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 392/767] 10.222.0.69 () {60 vars in 1322 bytes} [Wed May 4 19:11:59 2022] POST /compute/v2.1/servers/c0ca0b46-570c-45ff-820a-87a4197033f3/os-volume_attachments => generated 194 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:12:00.214718 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-043a01d8-992b-4b15-a066-8608795acf85 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:00.223983 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-043a01d8-992b-4b15-a066-8608795acf85 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 200 len: 1689 microversion: 2.1 time: 0.267532 May 04 19:12:00.224571 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 376/768] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:11:59 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 1689 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:12:00.590000 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-c740ea5e-6853-4d3f-84ff-b8a6fe8d34e6 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:00.591037 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-c740ea5e-6853-4d3f-84ff-b8a6fe8d34e6 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:00.602349 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c740ea5e-6853-4d3f-84ff-b8a6fe8d34e6 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:00.602998 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c740ea5e-6853-4d3f-84ff-b8a6fe8d34e6 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:00.604168 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c740ea5e-6853-4d3f-84ff-b8a6fe8d34e6 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:00.604764 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c740ea5e-6853-4d3f-84ff-b8a6fe8d34e6 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:00.831549 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-472cb4ae-86c4-4974-9d8a-f929bbfe72d0 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:00.831549 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-472cb4ae-86c4-4974-9d8a-f929bbfe72d0 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 81874ac9-ec8c-4fb1-bd75-762920f7042d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:00.846319 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-472cb4ae-86c4-4974-9d8a-f929bbfe72d0 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:00.846693 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-472cb4ae-86c4-4974-9d8a-f929bbfe72d0 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:00.847477 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-472cb4ae-86c4-4974-9d8a-f929bbfe72d0 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:00.847927 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-472cb4ae-86c4-4974-9d8a-f929bbfe72d0 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:00.878635 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-c740ea5e-6853-4d3f-84ff-b8a6fe8d34e6 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:00.887341 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-c740ea5e-6853-4d3f-84ff-b8a6fe8d34e6 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:00.888848 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-c740ea5e-6853-4d3f-84ff-b8a6fe8d34e6 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:00.904936 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-c740ea5e-6853-4d3f-84ff-b8a6fe8d34e6 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1739 microversion: 2.20 time: 0.320201 May 04 19:12:00.905849 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 393/769] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:12:00 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1739 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:12:01.041398 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-472cb4ae-86c4-4974-9d8a-f929bbfe72d0 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:01.049596 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-472cb4ae-86c4-4974-9d8a-f929bbfe72d0 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/81874ac9-ec8c-4fb1-bd75-762920f7042d" status: 200 len: 1615 microversion: 2.1 time: 0.223020 May 04 19:12:01.055355 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 377/770] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:12:00 2022] GET /compute/v2.1/servers/81874ac9-ec8c-4fb1-bd75-762920f7042d => generated 1615 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:12:01.098905 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-91c53220-6239-43fd-aea2-fd932ecd0666 req-3a0287df-e73f-444f-aa7f-d69d56f3cf8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17de0a81-ab42-475e-b6f3-dd853adc826c", "name": "network-vif-deleted", "tag": "e11de5fb-b02b-4516-8fa9-a612b9b432a0"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:12:01.109135 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-91c53220-6239-43fd-aea2-fd932ecd0666 req-3a0287df-e73f-444f-aa7f-d69d56f3cf8e service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:01.118425 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-91c53220-6239-43fd-aea2-fd932ecd0666 req-3a0287df-e73f-444f-aa7f-d69d56f3cf8e service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:01.155067 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-91c53220-6239-43fd-aea2-fd932ecd0666 req-3a0287df-e73f-444f-aa7f-d69d56f3cf8e service nova] Creating event network-vif-deleted:e11de5fb-b02b-4516-8fa9-a612b9b432a0 for instance 17de0a81-ab42-475e-b6f3-dd853adc826c on hv-cinder-83090 May 04 19:12:01.169302 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-91c53220-6239-43fd-aea2-fd932ecd0666 req-3a0287df-e73f-444f-aa7f-d69d56f3cf8e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.209009 May 04 19:12:01.170187 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 394/771] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:12:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:12:01.242644 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-6568a7d5-d97f-482a-a949-a538ff889cc0 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:01.243537 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-6568a7d5-d97f-482a-a949-a538ff889cc0 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:01.254995 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6568a7d5-d97f-482a-a949-a538ff889cc0 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:01.255887 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6568a7d5-d97f-482a-a949-a538ff889cc0 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:01.257078 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6568a7d5-d97f-482a-a949-a538ff889cc0 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:01.257805 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6568a7d5-d97f-482a-a949-a538ff889cc0 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:01.310004 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6568a7d5-d97f-482a-a949-a538ff889cc0 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:01.310692 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6568a7d5-d97f-482a-a949-a538ff889cc0 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:01.311314 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.objects.instance [None req-6568a7d5-d97f-482a-a949-a538ff889cc0 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lazy-loading 'fault' on Instance uuid 17de0a81-ab42-475e-b6f3-dd853adc826c {{(pid=117125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 04 19:12:01.392841 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-6568a7d5-d97f-482a-a949-a538ff889cc0 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:01.424767 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-6568a7d5-d97f-482a-a949-a538ff889cc0 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 200 len: 1335 microversion: 2.1 time: 0.187097 May 04 19:12:01.429360 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 378/772] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:12:01 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 1335 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:12:01.558776 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-7f686737-69dc-4d32-b371-8d4519663860 req-9fd68425-ecb0-420d-9e3c-b3c0210465e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81874ac9-ec8c-4fb1-bd75-762920f7042d", "name": "network-vif-deleted", "tag": "1087fa4e-a377-4af8-a39c-8bc9ddffd2db"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:12:01.572627 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-7f686737-69dc-4d32-b371-8d4519663860 req-9fd68425-ecb0-420d-9e3c-b3c0210465e6 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:01.576219 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-7f686737-69dc-4d32-b371-8d4519663860 req-9fd68425-ecb0-420d-9e3c-b3c0210465e6 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:01.602027 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-7f686737-69dc-4d32-b371-8d4519663860 req-9fd68425-ecb0-420d-9e3c-b3c0210465e6 service nova] Creating event network-vif-deleted:1087fa4e-a377-4af8-a39c-8bc9ddffd2db for instance 81874ac9-ec8c-4fb1-bd75-762920f7042d on hv-cinder-83090 May 04 19:12:01.607737 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-7f686737-69dc-4d32-b371-8d4519663860 req-9fd68425-ecb0-420d-9e3c-b3c0210465e6 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149751 May 04 19:12:01.625087 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 395/773] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:12:01.927812 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-d7e061d9-6f86-4116-9d9f-05e78e8d5d1f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:01.929127 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-d7e061d9-6f86-4116-9d9f-05e78e8d5d1f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:01.938498 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d7e061d9-6f86-4116-9d9f-05e78e8d5d1f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:01.943719 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d7e061d9-6f86-4116-9d9f-05e78e8d5d1f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:01.946766 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d7e061d9-6f86-4116-9d9f-05e78e8d5d1f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:01.947400 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d7e061d9-6f86-4116-9d9f-05e78e8d5d1f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:02.072617 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-6c2cb4b8-48eb-49be-b9fb-78d834aec055 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:02.073795 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-6c2cb4b8-48eb-49be-b9fb-78d834aec055 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 81874ac9-ec8c-4fb1-bd75-762920f7042d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:02.083756 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6c2cb4b8-48eb-49be-b9fb-78d834aec055 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:02.092164 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6c2cb4b8-48eb-49be-b9fb-78d834aec055 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:02.095425 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6c2cb4b8-48eb-49be-b9fb-78d834aec055 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:02.096071 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6c2cb4b8-48eb-49be-b9fb-78d834aec055 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:02.174483 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-d7e061d9-6f86-4116-9d9f-05e78e8d5d1f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:02.183227 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6c2cb4b8-48eb-49be-b9fb-78d834aec055 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:02.183801 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6c2cb4b8-48eb-49be-b9fb-78d834aec055 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:02.184824 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.objects.instance [None req-6c2cb4b8-48eb-49be-b9fb-78d834aec055 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lazy-loading 'fault' on Instance uuid 81874ac9-ec8c-4fb1-bd75-762920f7042d {{(pid=117124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 04 19:12:02.185980 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-d7e061d9-6f86-4116-9d9f-05e78e8d5d1f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:02.187756 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-d7e061d9-6f86-4116-9d9f-05e78e8d5d1f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:02.189316 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-d7e061d9-6f86-4116-9d9f-05e78e8d5d1f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1739 microversion: 2.20 time: 0.265746 May 04 19:12:02.190925 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 379/774] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:12:01 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1739 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 04 19:12:02.299004 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-6c2cb4b8-48eb-49be-b9fb-78d834aec055 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:02.310240 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-6c2cb4b8-48eb-49be-b9fb-78d834aec055 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/81874ac9-ec8c-4fb1-bd75-762920f7042d" status: 200 len: 1332 microversion: 2.1 time: 0.240515 May 04 19:12:02.328451 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 396/775] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:12:02 2022] GET /compute/v2.1/servers/81874ac9-ec8c-4fb1-bd75-762920f7042d => generated 1332 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:12:02.442387 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-c8c5d4d3-162e-49b0-93cb-6bbd1b9a294c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:02.443000 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-c8c5d4d3-162e-49b0-93cb-6bbd1b9a294c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 17de0a81-ab42-475e-b6f3-dd853adc826c] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:02.450308 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c8c5d4d3-162e-49b0-93cb-6bbd1b9a294c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:02.450566 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c8c5d4d3-162e-49b0-93cb-6bbd1b9a294c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:02.451348 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c8c5d4d3-162e-49b0-93cb-6bbd1b9a294c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:02.451786 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c8c5d4d3-162e-49b0-93cb-6bbd1b9a294c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:02.468310 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.wsgi [None req-c8c5d4d3-162e-49b0-93cb-6bbd1b9a294c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] HTTP exception thrown: Instance 17de0a81-ab42-475e-b6f3-dd853adc826c could not be found. May 04 19:12:02.469243 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-c8c5d4d3-162e-49b0-93cb-6bbd1b9a294c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Returning 404 to user: Instance 17de0a81-ab42-475e-b6f3-dd853adc826c could not be found. {{(pid=117125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 04 19:12:02.470310 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-c8c5d4d3-162e-49b0-93cb-6bbd1b9a294c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c" status: 404 len: 111 microversion: 2.1 time: 0.031824 May 04 19:12:02.471026 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 380/776] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:12:02 2022] GET /compute/v2.1/servers/17de0a81-ab42-475e-b6f3-dd853adc826c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 04 19:12:02.479595 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-7fc0ce34-84ac-4168-87ab-2e69a42c300c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '.version_select at 0x7fc3fb2669d0>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:02.501455 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-7fc0ce34-84ac-4168-87ab-2e69a42c300c tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-828635571" status: 202 len: 0 microversion: 2.1 time: 0.025901 May 04 19:12:02.502510 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 397/777] 10.222.0.69 () {58 vars in 1217 bytes} [Wed May 4 19:12:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-828635571 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 04 19:12:03.208656 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-48345444-ccd0-4d6b-a132-37b720049087 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:03.209215 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-48345444-ccd0-4d6b-a132-37b720049087 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:03.220597 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-48345444-ccd0-4d6b-a132-37b720049087 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:03.221291 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-48345444-ccd0-4d6b-a132-37b720049087 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:03.222293 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-48345444-ccd0-4d6b-a132-37b720049087 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:03.222887 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-48345444-ccd0-4d6b-a132-37b720049087 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:03.328175 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-97d98df5-c832-4f1a-8ffe-0b7157e477f4 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:03.328777 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-97d98df5-c832-4f1a-8ffe-0b7157e477f4 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 81874ac9-ec8c-4fb1-bd75-762920f7042d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:03.342785 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-97d98df5-c832-4f1a-8ffe-0b7157e477f4 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:03.343272 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-97d98df5-c832-4f1a-8ffe-0b7157e477f4 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:03.343974 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-97d98df5-c832-4f1a-8ffe-0b7157e477f4 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:03.350098 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-97d98df5-c832-4f1a-8ffe-0b7157e477f4 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:03.386391 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.wsgi [None req-97d98df5-c832-4f1a-8ffe-0b7157e477f4 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] HTTP exception thrown: Instance 81874ac9-ec8c-4fb1-bd75-762920f7042d could not be found. May 04 19:12:03.388494 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-97d98df5-c832-4f1a-8ffe-0b7157e477f4 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Returning 404 to user: Instance 81874ac9-ec8c-4fb1-bd75-762920f7042d could not be found. {{(pid=117124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 04 19:12:03.389997 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-97d98df5-c832-4f1a-8ffe-0b7157e477f4 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/81874ac9-ec8c-4fb1-bd75-762920f7042d" status: 404 len: 111 microversion: 2.1 time: 0.066135 May 04 19:12:03.392511 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 398/778] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:12:03 2022] GET /compute/v2.1/servers/81874ac9-ec8c-4fb1-bd75-762920f7042d => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 04 19:12:03.401168 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-9ae14536-078a-4461-bfa3-d247db198485 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '.version_select at 0x7fc3fb2cc820>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:03.421488 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-48345444-ccd0-4d6b-a132-37b720049087 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:03.435818 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-48345444-ccd0-4d6b-a132-37b720049087 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:03.439459 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-48345444-ccd0-4d6b-a132-37b720049087 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:03.441357 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-48345444-ccd0-4d6b-a132-37b720049087 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1739 microversion: 2.20 time: 0.236698 May 04 19:12:03.442363 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 381/779] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:12:03 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1739 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 04 19:12:03.456689 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-9ae14536-078a-4461-bfa3-d247db198485 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2035057183" status: 202 len: 0 microversion: 2.1 time: 0.059396 May 04 19:12:03.460893 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 399/780] 10.222.0.69 () {58 vars in 1220 bytes} [Wed May 4 19:12:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2035057183 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 04 19:12:04.191721 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-4a04ede0-b623-4917-bd06-2e3bf825d6d4 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Action: 'create', calling method: .version_select at 0x7fc3f61a1b80>, body: {"keypair": {"name": "tempest-keypair-420589444"}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:12:04.205413 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-4a04ede0-b623-4917-bd06-2e3bf825d6d4 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Getting quotas for project ef1ba9318cf84308a3ff6ce6da85755d. Resources: {'key_pairs'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 04 19:12:04.209563 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-4a04ede0-b623-4917-bd06-2e3bf825d6d4 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Getting quotas for user 98211cfafca84542a64f8b3f0b34303b and project ef1ba9318cf84308a3ff6ce6da85755d. Resources: {'key_pairs'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 04 19:12:04.343300 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-4a04ede0-b623-4917-bd06-2e3bf825d6d4 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Getting quotas for project ef1ba9318cf84308a3ff6ce6da85755d. Resources: {'key_pairs'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 04 19:12:04.347248 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-4a04ede0-b623-4917-bd06-2e3bf825d6d4 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Getting quotas for user 98211cfafca84542a64f8b3f0b34303b and project ef1ba9318cf84308a3ff6ce6da85755d. Resources: {'key_pairs'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 04 19:12:04.361094 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-4a04ede0-b623-4917-bd06-2e3bf825d6d4 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.174852 May 04 19:12:04.361733 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 382/781] 10.222.0.69 () {60 vars in 1157 bytes} [Wed May 4 19:12:04 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:12:04.476646 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-a39bcb62-eaa2-4c57-951a-2db88aeab464 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:04.477794 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-a39bcb62-eaa2-4c57-951a-2db88aeab464 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:04.507321 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a39bcb62-eaa2-4c57-951a-2db88aeab464 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:04.507895 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a39bcb62-eaa2-4c57-951a-2db88aeab464 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:04.508751 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a39bcb62-eaa2-4c57-951a-2db88aeab464 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:04.509248 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a39bcb62-eaa2-4c57-951a-2db88aeab464 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:04.692473 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-a39bcb62-eaa2-4c57-951a-2db88aeab464 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:04.705998 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-a39bcb62-eaa2-4c57-951a-2db88aeab464 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:04.708843 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-a39bcb62-eaa2-4c57-951a-2db88aeab464 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:04.711122 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-a39bcb62-eaa2-4c57-951a-2db88aeab464 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1739 microversion: 2.20 time: 0.253294 May 04 19:12:04.711803 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 400/782] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:12:04 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1739 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:12:05.663028 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-c7264949-c009-4bb2-aa83-53336c2368b2 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:05.663028 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-c7264949-c009-4bb2-aa83-53336c2368b2 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 4b5bd528-4bc3-4bf3-be31-89364096663f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:05.671590 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c7264949-c009-4bb2-aa83-53336c2368b2 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:05.672177 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c7264949-c009-4bb2-aa83-53336c2368b2 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:05.673064 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c7264949-c009-4bb2-aa83-53336c2368b2 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:05.673671 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c7264949-c009-4bb2-aa83-53336c2368b2 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:05.708262 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-c7264949-c009-4bb2-aa83-53336c2368b2 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 4b5bd528-4bc3-4bf3-be31-89364096663f] Going to try to terminate instance {{(pid=117125) delete /opt/stack/nova/nova/compute/api.py:2664}} May 04 19:12:05.732239 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-60a0a641-ada9-4657-8ad8-1cd738b15571 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:05.732842 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-60a0a641-ada9-4657-8ad8-1cd738b15571 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:05.739324 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-60a0a641-ada9-4657-8ad8-1cd738b15571 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:05.744747 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-60a0a641-ada9-4657-8ad8-1cd738b15571 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:05.746587 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-60a0a641-ada9-4657-8ad8-1cd738b15571 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:05.750750 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-60a0a641-ada9-4657-8ad8-1cd738b15571 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:05.832802 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-c7264949-c009-4bb2-aa83-53336c2368b2 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "DELETE /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f" status: 204 len: 0 microversion: 2.1 time: 0.173332 May 04 19:12:05.833829 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 383/783] 10.222.0.69 () {58 vars in 1238 bytes} [Wed May 4 19:12:05 2022] DELETE /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 04 19:12:05.843323 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-34dea65f-35ce-4f29-bc5e-35477151e699 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:05.844445 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-34dea65f-35ce-4f29-bc5e-35477151e699 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 4b5bd528-4bc3-4bf3-be31-89364096663f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:05.853014 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-34dea65f-35ce-4f29-bc5e-35477151e699 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:05.853960 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-34dea65f-35ce-4f29-bc5e-35477151e699 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:05.855073 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-34dea65f-35ce-4f29-bc5e-35477151e699 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:05.855610 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-34dea65f-35ce-4f29-bc5e-35477151e699 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:05.952460 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-60a0a641-ada9-4657-8ad8-1cd738b15571 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:05.969397 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-60a0a641-ada9-4657-8ad8-1cd738b15571 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:05.987326 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-60a0a641-ada9-4657-8ad8-1cd738b15571 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:05.988827 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-60a0a641-ada9-4657-8ad8-1cd738b15571 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1739 microversion: 2.20 time: 0.261037 May 04 19:12:05.989905 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 401/784] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:12:05 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1739 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:12:05.995093 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-41f7ce40-0eba-4d96-9142-46dfd1e3dc11 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-382687296", "imageRef": "2869595e-cda4-45af-aaeb-0779eb5f4114", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "52743f3b-665f-4119-9451-8ab735a2cc02"}], "security_groups": [{"name": "tempest-securitygroup--79127006"}], "key_name": "tempest-keypair-420589444", "user_data": "}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:12:06.048359 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-34dea65f-35ce-4f29-bc5e-35477151e699 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:06.056984 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-34dea65f-35ce-4f29-bc5e-35477151e699 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f" status: 200 len: 1506 microversion: 2.1 time: 0.218485 May 04 19:12:06.058117 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 384/785] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:12:05 2022] GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f => generated 1506 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:12:06.105314 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.network.neutron [None req-41f7ce40-0eba-4d96-9142-46dfd1e3dc11 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] validate_networks() for [('52743f3b-665f-4119-9451-8ab735a2cc02', None, None, None, None, None)] {{(pid=117124) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 04 19:12:06.504120 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-41f7ce40-0eba-4d96-9142-46dfd1e3dc11 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Flavor limits 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 04 19:12:06.504617 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-41f7ce40-0eba-4d96-9142-46dfd1e3dc11 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Image limits 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 04 19:12:06.505171 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-41f7ce40-0eba-4d96-9142-46dfd1e3dc11 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Flavor pref 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 04 19:12:06.505696 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-41f7ce40-0eba-4d96-9142-46dfd1e3dc11 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Image pref 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 04 19:12:06.506114 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-41f7ce40-0eba-4d96-9142-46dfd1e3dc11 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 04 19:12:06.515509 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-41f7ce40-0eba-4d96-9142-46dfd1e3dc11 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:06.515967 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-41f7ce40-0eba-4d96-9142-46dfd1e3dc11 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:06.517063 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-41f7ce40-0eba-4d96-9142-46dfd1e3dc11 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:06.517523 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-41f7ce40-0eba-4d96-9142-46dfd1e3dc11 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:06.534815 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-41f7ce40-0eba-4d96-9142-46dfd1e3dc11 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Getting quotas for project ef1ba9318cf84308a3ff6ce6da85755d. Resources: {'cores', 'ram', 'instances'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 04 19:12:06.542942 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-41f7ce40-0eba-4d96-9142-46dfd1e3dc11 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Getting quotas for user 98211cfafca84542a64f8b3f0b34303b and project ef1ba9318cf84308a3ff6ce6da85755d. Resources: {'cores', 'ram', 'instances'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 04 19:12:06.554878 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-41f7ce40-0eba-4d96-9142-46dfd1e3dc11 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Going to run 1 instances... {{(pid=117124) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 04 19:12:06.558654 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-41f7ce40-0eba-4d96-9142-46dfd1e3dc11 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 2af1ff2e-191e-467e-b95d-1bc5f35d7e15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2869595e-cda4-45af-aaeb-0779eb5f4114',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 04 19:12:06.610533 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-41f7ce40-0eba-4d96-9142-46dfd1e3dc11 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.619028 May 04 19:12:06.620867 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 402/786] 10.222.0.69 () {60 vars in 1146 bytes} [Wed May 4 19:12:05 2022] POST /compute/v2.1/servers => generated 400 bytes in 630 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 04 19:12:06.622137 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-ead0e9f4-bbf1-46f3-8479-be83336c45cf tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:06.622896 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-ead0e9f4-bbf1-46f3-8479-be83336c45cf tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 2af1ff2e-191e-467e-b95d-1bc5f35d7e15] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:06.682933 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-ead0e9f4-bbf1-46f3-8479-be83336c45cf tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:06.690807 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-ead0e9f4-bbf1-46f3-8479-be83336c45cf tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/2af1ff2e-191e-467e-b95d-1bc5f35d7e15" status: 200 len: 1240 microversion: 2.1 time: 0.073466 May 04 19:12:06.692297 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 385/787] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:12:06 2022] GET /compute/v2.1/servers/2af1ff2e-191e-467e-b95d-1bc5f35d7e15 => generated 1240 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:12:07.008843 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-37700d1f-7042-432b-b215-c516ae0331ec tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:07.009494 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-37700d1f-7042-432b-b215-c516ae0331ec tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:07.018489 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-37700d1f-7042-432b-b215-c516ae0331ec tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:07.019057 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-37700d1f-7042-432b-b215-c516ae0331ec tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:07.019948 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-37700d1f-7042-432b-b215-c516ae0331ec tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:07.020638 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-37700d1f-7042-432b-b215-c516ae0331ec tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:07.075258 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-55189abf-391f-4778-ada0-8d9a72006e2a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:07.076504 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-55189abf-391f-4778-ada0-8d9a72006e2a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 4b5bd528-4bc3-4bf3-be31-89364096663f] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:07.084736 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-55189abf-391f-4778-ada0-8d9a72006e2a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:07.085200 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-55189abf-391f-4778-ada0-8d9a72006e2a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:07.086246 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-55189abf-391f-4778-ada0-8d9a72006e2a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:07.086873 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-55189abf-391f-4778-ada0-8d9a72006e2a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:07.179975 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-37700d1f-7042-432b-b215-c516ae0331ec tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:07.188913 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-37700d1f-7042-432b-b215-c516ae0331ec tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:07.191042 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-37700d1f-7042-432b-b215-c516ae0331ec tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:07.193119 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-37700d1f-7042-432b-b215-c516ae0331ec tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1739 microversion: 2.20 time: 0.188456 May 04 19:12:07.199490 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 403/788] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:12:07 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1739 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:12:07.511632 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-55189abf-391f-4778-ada0-8d9a72006e2a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:07.519666 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-55189abf-391f-4778-ada0-8d9a72006e2a tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f" status: 200 len: 1506 microversion: 2.1 time: 0.448475 May 04 19:12:07.520309 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 386/789] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:12:07 2022] GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f => generated 1506 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:12:07.711291 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-fc6cbb84-da5d-473a-8c39-975a05bdc0ad tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:07.711910 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-fc6cbb84-da5d-473a-8c39-975a05bdc0ad tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 2af1ff2e-191e-467e-b95d-1bc5f35d7e15] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:07.720896 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fc6cbb84-da5d-473a-8c39-975a05bdc0ad tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:07.721618 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fc6cbb84-da5d-473a-8c39-975a05bdc0ad tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:07.722547 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fc6cbb84-da5d-473a-8c39-975a05bdc0ad tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:07.723479 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fc6cbb84-da5d-473a-8c39-975a05bdc0ad tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:07.796967 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-fc6cbb84-da5d-473a-8c39-975a05bdc0ad tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:07.807604 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-fc6cbb84-da5d-473a-8c39-975a05bdc0ad tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/2af1ff2e-191e-467e-b95d-1bc5f35d7e15" status: 200 len: 1236 microversion: 2.1 time: 0.100004 May 04 19:12:07.818917 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 404/790] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:12:07 2022] GET /compute/v2.1/servers/2af1ff2e-191e-467e-b95d-1bc5f35d7e15 => generated 1236 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:12:08.218145 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-5d17feba-f480-4b2b-9fce-18fffcb78a83 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:08.219484 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-5d17feba-f480-4b2b-9fce-18fffcb78a83 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:08.227128 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5d17feba-f480-4b2b-9fce-18fffcb78a83 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:08.227923 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5d17feba-f480-4b2b-9fce-18fffcb78a83 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:08.229570 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5d17feba-f480-4b2b-9fce-18fffcb78a83 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:08.230232 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5d17feba-f480-4b2b-9fce-18fffcb78a83 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:08.412732 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-5d17feba-f480-4b2b-9fce-18fffcb78a83 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:08.424058 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-5d17feba-f480-4b2b-9fce-18fffcb78a83 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:08.425915 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-5d17feba-f480-4b2b-9fce-18fffcb78a83 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:08.428498 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-5d17feba-f480-4b2b-9fce-18fffcb78a83 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1739 microversion: 2.20 time: 0.214315 May 04 19:12:08.429330 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 387/791] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:12:08 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1739 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:12:08.538731 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-2734dd56-fd97-4fd9-8b48-3dd83879f2e2 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:08.540141 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-2734dd56-fd97-4fd9-8b48-3dd83879f2e2 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 4b5bd528-4bc3-4bf3-be31-89364096663f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:08.552437 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2734dd56-fd97-4fd9-8b48-3dd83879f2e2 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:08.553154 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2734dd56-fd97-4fd9-8b48-3dd83879f2e2 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:08.553965 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2734dd56-fd97-4fd9-8b48-3dd83879f2e2 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:08.555715 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2734dd56-fd97-4fd9-8b48-3dd83879f2e2 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:08.824715 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-b102fd43-09fa-431f-bcb2-228aff033027 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:08.826837 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-b102fd43-09fa-431f-bcb2-228aff033027 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 2af1ff2e-191e-467e-b95d-1bc5f35d7e15] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:08.834278 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-2734dd56-fd97-4fd9-8b48-3dd83879f2e2 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:08.840314 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b102fd43-09fa-431f-bcb2-228aff033027 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:08.841034 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b102fd43-09fa-431f-bcb2-228aff033027 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:08.842046 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b102fd43-09fa-431f-bcb2-228aff033027 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:08.842921 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b102fd43-09fa-431f-bcb2-228aff033027 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:08.844558 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-2734dd56-fd97-4fd9-8b48-3dd83879f2e2 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f" status: 200 len: 1506 microversion: 2.1 time: 0.310211 May 04 19:12:08.847074 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 405/792] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:12:08 2022] GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f => generated 1506 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:12:08.910563 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-7e3f5e9d-555c-4323-a8f1-9e2c6c9684a2 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:08.912482 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-7e3f5e9d-555c-4323-a8f1-9e2c6c9684a2 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: c0ca0b46-570c-45ff-820a-87a4197033f3] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:08.923706 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7e3f5e9d-555c-4323-a8f1-9e2c6c9684a2 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:08.927918 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7e3f5e9d-555c-4323-a8f1-9e2c6c9684a2 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:08.929004 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7e3f5e9d-555c-4323-a8f1-9e2c6c9684a2 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:08.930850 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7e3f5e9d-555c-4323-a8f1-9e2c6c9684a2 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:08.965648 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-b102fd43-09fa-431f-bcb2-228aff033027 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:08.978051 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-b102fd43-09fa-431f-bcb2-228aff033027 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/2af1ff2e-191e-467e-b95d-1bc5f35d7e15" status: 200 len: 1298 microversion: 2.1 time: 0.157676 May 04 19:12:08.978939 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 388/793] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:12:08 2022] GET /compute/v2.1/servers/2af1ff2e-191e-467e-b95d-1bc5f35d7e15 => generated 1298 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:12:08.998311 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-7e3f5e9d-555c-4323-a8f1-9e2c6c9684a2 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/c0ca0b46-570c-45ff-820a-87a4197033f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092688 May 04 19:12:09.016804 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-8206e902-9986-44db-9e14-988e7ccb90fe tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:09.017321 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-8206e902-9986-44db-9e14-988e7ccb90fe tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: c0ca0b46-570c-45ff-820a-87a4197033f3] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:09.021029 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 406/794] 10.222.0.69 () {58 vars in 1301 bytes} [Wed May 4 19:12:08 2022] GET /compute/v2.1/servers/c0ca0b46-570c-45ff-820a-87a4197033f3/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 04 19:12:09.031129 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8206e902-9986-44db-9e14-988e7ccb90fe tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:09.031716 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8206e902-9986-44db-9e14-988e7ccb90fe tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:09.032602 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8206e902-9986-44db-9e14-988e7ccb90fe tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:09.033115 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8206e902-9986-44db-9e14-988e7ccb90fe tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:09.081282 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-8206e902-9986-44db-9e14-988e7ccb90fe tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/c0ca0b46-570c-45ff-820a-87a4197033f3/os-volume_attachments/06ed7258-b5fb-4dff-b0b5-58098a97e74d" status: 200 len: 194 microversion: 2.1 time: 0.074005 May 04 19:12:09.089553 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 389/795] 10.222.0.69 () {58 vars in 1412 bytes} [Wed May 4 19:12:09 2022] GET /compute/v2.1/servers/c0ca0b46-570c-45ff-820a-87a4197033f3/os-volume_attachments/06ed7258-b5fb-4dff-b0b5-58098a97e74d => generated 194 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:12:09.133684 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-78e9f7c8-8dca-428e-a1f2-3067697d8b5b req-0dbab647-b75e-4571-8b03-9583dada20e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b5bd528-4bc3-4bf3-be31-89364096663f", "name": "network-vif-deleted", "tag": "e803e0ad-7898-4a32-9dc5-0d5f670b9816"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:12:09.144058 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-78e9f7c8-8dca-428e-a1f2-3067697d8b5b req-0dbab647-b75e-4571-8b03-9583dada20e5 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:09.144915 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-78e9f7c8-8dca-428e-a1f2-3067697d8b5b req-0dbab647-b75e-4571-8b03-9583dada20e5 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:09.176721 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-78e9f7c8-8dca-428e-a1f2-3067697d8b5b req-0dbab647-b75e-4571-8b03-9583dada20e5 service nova] Creating event network-vif-deleted:e803e0ad-7898-4a32-9dc5-0d5f670b9816 for instance 4b5bd528-4bc3-4bf3-be31-89364096663f on hv-cinder-83090 May 04 19:12:09.184368 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-78e9f7c8-8dca-428e-a1f2-3067697d8b5b req-0dbab647-b75e-4571-8b03-9583dada20e5 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061575 May 04 19:12:09.185690 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 407/796] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:12:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:12:09.449992 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-b80639dc-ccec-44c8-a085-2c881aed553d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:09.451786 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-b80639dc-ccec-44c8-a085-2c881aed553d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:09.467839 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b80639dc-ccec-44c8-a085-2c881aed553d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:09.468305 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b80639dc-ccec-44c8-a085-2c881aed553d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:09.469108 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b80639dc-ccec-44c8-a085-2c881aed553d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:09.469586 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b80639dc-ccec-44c8-a085-2c881aed553d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:09.763880 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-b80639dc-ccec-44c8-a085-2c881aed553d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:09.783664 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-b80639dc-ccec-44c8-a085-2c881aed553d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:09.786376 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-b80639dc-ccec-44c8-a085-2c881aed553d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:09.792900 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-b80639dc-ccec-44c8-a085-2c881aed553d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1739 microversion: 2.20 time: 0.345678 May 04 19:12:09.794432 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 390/797] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:12:09 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1739 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:12:09.864433 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-e4dd61aa-7b39-4de7-a373-4757c0790f54 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:09.866317 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-e4dd61aa-7b39-4de7-a373-4757c0790f54 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 4b5bd528-4bc3-4bf3-be31-89364096663f] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:09.873674 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e4dd61aa-7b39-4de7-a373-4757c0790f54 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:09.874130 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e4dd61aa-7b39-4de7-a373-4757c0790f54 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:09.874927 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e4dd61aa-7b39-4de7-a373-4757c0790f54 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:09.875344 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e4dd61aa-7b39-4de7-a373-4757c0790f54 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:09.899729 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.wsgi [None req-e4dd61aa-7b39-4de7-a373-4757c0790f54 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] HTTP exception thrown: Instance 4b5bd528-4bc3-4bf3-be31-89364096663f could not be found. May 04 19:12:09.900335 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-e4dd61aa-7b39-4de7-a373-4757c0790f54 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Returning 404 to user: Instance 4b5bd528-4bc3-4bf3-be31-89364096663f could not be found. {{(pid=117124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 04 19:12:09.901740 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-e4dd61aa-7b39-4de7-a373-4757c0790f54 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f" status: 404 len: 111 microversion: 2.1 time: 0.041991 May 04 19:12:09.902801 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 408/798] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:12:09 2022] GET /compute/v2.1/servers/4b5bd528-4bc3-4bf3-be31-89364096663f => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 04 19:12:09.910652 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-d4b09b07-0366-45f5-847d-741df2122728 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:09.911352 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-d4b09b07-0366-45f5-847d-741df2122728 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 150304bb-d8d1-4c08-93b6-fc07c69fd846] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:09.919216 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d4b09b07-0366-45f5-847d-741df2122728 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:09.919917 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d4b09b07-0366-45f5-847d-741df2122728 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:09.920891 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d4b09b07-0366-45f5-847d-741df2122728 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:09.921882 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d4b09b07-0366-45f5-847d-741df2122728 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:09.956674 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-d4b09b07-0366-45f5-847d-741df2122728 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 150304bb-d8d1-4c08-93b6-fc07c69fd846] Going to try to terminate instance {{(pid=117125) delete /opt/stack/nova/nova/compute/api.py:2664}} May 04 19:12:09.996208 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-883d4c9f-8cf8-45a5-8993-fd583d6b982d tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:09.996825 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-883d4c9f-8cf8-45a5-8993-fd583d6b982d tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 2af1ff2e-191e-467e-b95d-1bc5f35d7e15] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:10.011311 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-883d4c9f-8cf8-45a5-8993-fd583d6b982d tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:10.011767 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-883d4c9f-8cf8-45a5-8993-fd583d6b982d tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:10.012557 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-883d4c9f-8cf8-45a5-8993-fd583d6b982d tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:10.013000 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-883d4c9f-8cf8-45a5-8993-fd583d6b982d tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:10.130503 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-d4b09b07-0366-45f5-847d-741df2122728 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "DELETE /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846" status: 204 len: 0 microversion: 2.1 time: 0.223371 May 04 19:12:10.131954 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 391/799] 10.222.0.69 () {58 vars in 1238 bytes} [Wed May 4 19:12:09 2022] DELETE /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 04 19:12:10.143873 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-c05696bc-a1c8-4006-8d2e-265e7eabd802 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:10.145073 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-c05696bc-a1c8-4006-8d2e-265e7eabd802 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 150304bb-d8d1-4c08-93b6-fc07c69fd846] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:10.156252 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c05696bc-a1c8-4006-8d2e-265e7eabd802 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:10.156803 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c05696bc-a1c8-4006-8d2e-265e7eabd802 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:10.157706 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c05696bc-a1c8-4006-8d2e-265e7eabd802 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:10.158212 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c05696bc-a1c8-4006-8d2e-265e7eabd802 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:10.260719 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-883d4c9f-8cf8-45a5-8993-fd583d6b982d tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:10.269752 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-883d4c9f-8cf8-45a5-8993-fd583d6b982d tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/2af1ff2e-191e-467e-b95d-1bc5f35d7e15" status: 200 len: 1364 microversion: 2.1 time: 0.277455 May 04 19:12:10.270887 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 409/800] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:12:09 2022] GET /compute/v2.1/servers/2af1ff2e-191e-467e-b95d-1bc5f35d7e15 => generated 1364 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:12:10.403321 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-c05696bc-a1c8-4006-8d2e-265e7eabd802 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:10.412272 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-c05696bc-a1c8-4006-8d2e-265e7eabd802 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846" status: 200 len: 1520 microversion: 2.1 time: 0.273583 May 04 19:12:10.413301 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 392/801] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:12:10 2022] GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846 => generated 1520 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:12:10.733160 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-fa8abd78-2a72-49fa-97b9-c70f52c11ff5 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3cf936ae-3e42-46ce-8c9d-1d487aaccf97"}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:12:10.734406 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-fa8abd78-2a72-49fa-97b9-c70f52c11ff5 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: c0ca0b46-570c-45ff-820a-87a4197033f3] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:10.751013 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fa8abd78-2a72-49fa-97b9-c70f52c11ff5 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:10.751476 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fa8abd78-2a72-49fa-97b9-c70f52c11ff5 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:10.752339 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fa8abd78-2a72-49fa-97b9-c70f52c11ff5 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:10.752820 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fa8abd78-2a72-49fa-97b9-c70f52c11ff5 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:10.814502 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-2257161e-7ea0-4d5e-ac25-d46e8fd0db6c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:10.815349 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-2257161e-7ea0-4d5e-ac25-d46e8fd0db6c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:10.826459 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2257161e-7ea0-4d5e-ac25-d46e8fd0db6c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:10.827151 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2257161e-7ea0-4d5e-ac25-d46e8fd0db6c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:10.828132 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2257161e-7ea0-4d5e-ac25-d46e8fd0db6c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:10.828761 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2257161e-7ea0-4d5e-ac25-d46e8fd0db6c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:11.014150 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-2257161e-7ea0-4d5e-ac25-d46e8fd0db6c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:11.023560 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-2257161e-7ea0-4d5e-ac25-d46e8fd0db6c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:11.025148 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-2257161e-7ea0-4d5e-ac25-d46e8fd0db6c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:11.027124 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-2257161e-7ea0-4d5e-ac25-d46e8fd0db6c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1739 microversion: 2.20 time: 0.216441 May 04 19:12:11.027711 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 393/802] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:12:10 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1739 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 04 19:12:11.032691 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-0bab7d83-b1d2-4ce3-833f-f29d375e4235 req-2466eedc-081a-482c-b96b-64ba735bf991 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2af1ff2e-191e-467e-b95d-1bc5f35d7e15", "tag": "7f533959-c4f2-4e4f-a8ac-4b978c96fb26"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:12:11.042310 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-0bab7d83-b1d2-4ce3-833f-f29d375e4235 req-2466eedc-081a-482c-b96b-64ba735bf991 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:11.042760 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-0bab7d83-b1d2-4ce3-833f-f29d375e4235 req-2466eedc-081a-482c-b96b-64ba735bf991 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:11.055862 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-0bab7d83-b1d2-4ce3-833f-f29d375e4235 req-2466eedc-081a-482c-b96b-64ba735bf991 service nova] Creating event network-changed:7f533959-c4f2-4e4f-a8ac-4b978c96fb26 for instance 2af1ff2e-191e-467e-b95d-1bc5f35d7e15 on hv-cinder-83090 May 04 19:12:11.061984 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-0bab7d83-b1d2-4ce3-833f-f29d375e4235 req-2466eedc-081a-482c-b96b-64ba735bf991 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032727 May 04 19:12:11.062684 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 394/803] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:12:11.287269 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-fd2fbb21-f591-41a1-8463-f87513fde229 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:11.288242 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-fd2fbb21-f591-41a1-8463-f87513fde229 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 2af1ff2e-191e-467e-b95d-1bc5f35d7e15] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:11.297718 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-fd2fbb21-f591-41a1-8463-f87513fde229 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:11.298411 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-fd2fbb21-f591-41a1-8463-f87513fde229 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:11.299340 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-fd2fbb21-f591-41a1-8463-f87513fde229 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:11.299949 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-fd2fbb21-f591-41a1-8463-f87513fde229 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:11.457584 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-fd2fbb21-f591-41a1-8463-f87513fde229 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:11.465956 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-fd2fbb21-f591-41a1-8463-f87513fde229 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/2af1ff2e-191e-467e-b95d-1bc5f35d7e15" status: 200 len: 1364 microversion: 2.1 time: 0.183061 May 04 19:12:11.466527 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 395/804] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:12:11 2022] GET /compute/v2.1/servers/2af1ff2e-191e-467e-b95d-1bc5f35d7e15 => generated 1364 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:12:11.471258 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-998cf13e-0315-49f9-aedd-eb47b2001d54 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:11.472049 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-998cf13e-0315-49f9-aedd-eb47b2001d54 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 150304bb-d8d1-4c08-93b6-fc07c69fd846] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:11.480734 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-998cf13e-0315-49f9-aedd-eb47b2001d54 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:11.481483 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-998cf13e-0315-49f9-aedd-eb47b2001d54 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:11.482425 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-998cf13e-0315-49f9-aedd-eb47b2001d54 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:11.483158 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-998cf13e-0315-49f9-aedd-eb47b2001d54 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:11.627362 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-998cf13e-0315-49f9-aedd-eb47b2001d54 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:11.635707 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-998cf13e-0315-49f9-aedd-eb47b2001d54 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846" status: 200 len: 1520 microversion: 2.1 time: 0.167470 May 04 19:12:11.645492 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 396/805] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:12:11 2022] GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:12:12.045994 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-54a9ff9d-6e8e-4755-b397-07eefdc7c33d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:12.046596 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-54a9ff9d-6e8e-4755-b397-07eefdc7c33d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:12.053011 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-54a9ff9d-6e8e-4755-b397-07eefdc7c33d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:12.053474 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-54a9ff9d-6e8e-4755-b397-07eefdc7c33d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:12.054259 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-54a9ff9d-6e8e-4755-b397-07eefdc7c33d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:12.054693 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-54a9ff9d-6e8e-4755-b397-07eefdc7c33d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:12.182809 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-54a9ff9d-6e8e-4755-b397-07eefdc7c33d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:12.190607 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-54a9ff9d-6e8e-4755-b397-07eefdc7c33d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:12.192100 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-54a9ff9d-6e8e-4755-b397-07eefdc7c33d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:12.193441 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-54a9ff9d-6e8e-4755-b397-07eefdc7c33d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1739 microversion: 2.20 time: 0.151343 May 04 19:12:12.194284 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 397/806] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:12:12 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1739 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 04 19:12:12.483040 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-ad20cff2-f4fb-432d-a20a-0388fc8f3651 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:12.483655 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-ad20cff2-f4fb-432d-a20a-0388fc8f3651 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 2af1ff2e-191e-467e-b95d-1bc5f35d7e15] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:12.489590 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ad20cff2-f4fb-432d-a20a-0388fc8f3651 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:12.490039 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ad20cff2-f4fb-432d-a20a-0388fc8f3651 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:12.490802 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ad20cff2-f4fb-432d-a20a-0388fc8f3651 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:12.491235 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ad20cff2-f4fb-432d-a20a-0388fc8f3651 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:12.617347 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-ad20cff2-f4fb-432d-a20a-0388fc8f3651 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:12.624514 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-ad20cff2-f4fb-432d-a20a-0388fc8f3651 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/2af1ff2e-191e-467e-b95d-1bc5f35d7e15" status: 200 len: 1364 microversion: 2.1 time: 0.145949 May 04 19:12:12.625116 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 398/807] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:12:12 2022] GET /compute/v2.1/servers/2af1ff2e-191e-467e-b95d-1bc5f35d7e15 => generated 1364 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:12:12.652473 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-43f83dd1-aed4-4320-89b6-c0c5440652d0 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:12.653074 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-43f83dd1-aed4-4320-89b6-c0c5440652d0 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 150304bb-d8d1-4c08-93b6-fc07c69fd846] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:12.658773 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-43f83dd1-aed4-4320-89b6-c0c5440652d0 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:12.659223 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-43f83dd1-aed4-4320-89b6-c0c5440652d0 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:12.659977 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-43f83dd1-aed4-4320-89b6-c0c5440652d0 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:12.660409 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-43f83dd1-aed4-4320-89b6-c0c5440652d0 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:12.824213 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-fa8abd78-2a72-49fa-97b9-c70f52c11ff5 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "POST /compute/v2.1/servers/c0ca0b46-570c-45ff-820a-87a4197033f3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.095574 May 04 19:12:12.829446 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 410/808] 10.222.0.69 () {60 vars in 1322 bytes} [Wed May 4 19:12:10 2022] POST /compute/v2.1/servers/c0ca0b46-570c-45ff-820a-87a4197033f3/os-volume_attachments => generated 194 bytes in 2102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:12:12.940897 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-43f83dd1-aed4-4320-89b6-c0c5440652d0 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:12.951597 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-43f83dd1-aed4-4320-89b6-c0c5440652d0 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846" status: 200 len: 1520 microversion: 2.1 time: 0.301335 May 04 19:12:12.961812 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 399/809] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:12:12 2022] GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846 => generated 1520 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:12:13.212073 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-4c3c5ac0-d3ad-4f19-ab4f-9320485d408f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:13.212770 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-4c3c5ac0-d3ad-4f19-ab4f-9320485d408f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:13.219440 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4c3c5ac0-d3ad-4f19-ab4f-9320485d408f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:13.219886 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4c3c5ac0-d3ad-4f19-ab4f-9320485d408f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:13.220666 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4c3c5ac0-d3ad-4f19-ab4f-9320485d408f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:13.221106 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4c3c5ac0-d3ad-4f19-ab4f-9320485d408f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:13.508387 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-4c3c5ac0-d3ad-4f19-ab4f-9320485d408f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:13.518486 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-4c3c5ac0-d3ad-4f19-ab4f-9320485d408f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:13.520096 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-4c3c5ac0-d3ad-4f19-ab4f-9320485d408f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:13.521509 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-4c3c5ac0-d3ad-4f19-ab4f-9320485d408f tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1721 microversion: 2.20 time: 0.314243 May 04 19:12:13.522128 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 411/810] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:12:13 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1721 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:12:13.642431 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-059ee7b4-d077-4943-acbb-67d8d343ced5 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:13.643142 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-059ee7b4-d077-4943-acbb-67d8d343ced5 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 2af1ff2e-191e-467e-b95d-1bc5f35d7e15] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:13.649530 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-059ee7b4-d077-4943-acbb-67d8d343ced5 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:13.650052 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-059ee7b4-d077-4943-acbb-67d8d343ced5 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:13.650922 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-059ee7b4-d077-4943-acbb-67d8d343ced5 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:13.651422 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-059ee7b4-d077-4943-acbb-67d8d343ced5 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:13.721851 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-4b2a09c2-06db-43f1-b89b-d271cf4b018b req-b7bf77ef-9cfa-4299-ae1b-b5cca9876c01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "150304bb-d8d1-4c08-93b6-fc07c69fd846", "name": "network-vif-deleted", "tag": "ba9cc838-25e8-4a65-849a-ef79368d718d"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:12:13.731474 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-4b2a09c2-06db-43f1-b89b-d271cf4b018b req-b7bf77ef-9cfa-4299-ae1b-b5cca9876c01 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:13.731974 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-4b2a09c2-06db-43f1-b89b-d271cf4b018b req-b7bf77ef-9cfa-4299-ae1b-b5cca9876c01 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:13.747857 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-4b2a09c2-06db-43f1-b89b-d271cf4b018b req-b7bf77ef-9cfa-4299-ae1b-b5cca9876c01 service nova] Creating event network-vif-deleted:ba9cc838-25e8-4a65-849a-ef79368d718d for instance 150304bb-d8d1-4c08-93b6-fc07c69fd846 on hv-cinder-83090 May 04 19:12:13.753795 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-4b2a09c2-06db-43f1-b89b-d271cf4b018b req-b7bf77ef-9cfa-4299-ae1b-b5cca9876c01 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035646 May 04 19:12:13.754731 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 412/811] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:12:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 04 19:12:13.802814 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-059ee7b4-d077-4943-acbb-67d8d343ced5 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:13.810731 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-059ee7b4-d077-4943-acbb-67d8d343ced5 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/2af1ff2e-191e-467e-b95d-1bc5f35d7e15" status: 200 len: 1364 microversion: 2.1 time: 0.172513 May 04 19:12:13.811297 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 400/812] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:12:13 2022] GET /compute/v2.1/servers/2af1ff2e-191e-467e-b95d-1bc5f35d7e15 => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:12:13.967358 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-532ba392-524b-4051-b807-4db5e968f291 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:13.968052 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-532ba392-524b-4051-b807-4db5e968f291 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 150304bb-d8d1-4c08-93b6-fc07c69fd846] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:13.974138 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-532ba392-524b-4051-b807-4db5e968f291 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:13.974581 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-532ba392-524b-4051-b807-4db5e968f291 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:13.975340 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-532ba392-524b-4051-b807-4db5e968f291 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:13.975769 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-532ba392-524b-4051-b807-4db5e968f291 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:14.043522 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-532ba392-524b-4051-b807-4db5e968f291 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:14.052787 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-532ba392-524b-4051-b807-4db5e968f291 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846" status: 200 len: 1478 microversion: 2.1 time: 0.089009 May 04 19:12:14.053941 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 413/813] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:12:13 2022] GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846 => generated 1478 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:12:14.539660 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-00099285-6baf-4c4f-a2da-8a1be9b4b5a4 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:14.540559 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-00099285-6baf-4c4f-a2da-8a1be9b4b5a4 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:14.546538 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-00099285-6baf-4c4f-a2da-8a1be9b4b5a4 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:14.546988 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-00099285-6baf-4c4f-a2da-8a1be9b4b5a4 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:14.547752 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-00099285-6baf-4c4f-a2da-8a1be9b4b5a4 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:14.548190 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-00099285-6baf-4c4f-a2da-8a1be9b4b5a4 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:14.676556 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-00099285-6baf-4c4f-a2da-8a1be9b4b5a4 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:14.684864 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-00099285-6baf-4c4f-a2da-8a1be9b4b5a4 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:14.686417 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-00099285-6baf-4c4f-a2da-8a1be9b4b5a4 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:14.687576 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-00099285-6baf-4c4f-a2da-8a1be9b4b5a4 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1721 microversion: 2.20 time: 0.151824 May 04 19:12:14.688136 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 401/814] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:12:14 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:12:14.828252 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-67527cf1-8a4e-4831-878b-c5608b6ad32e tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:14.828869 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-67527cf1-8a4e-4831-878b-c5608b6ad32e tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 2af1ff2e-191e-467e-b95d-1bc5f35d7e15] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:14.835234 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-67527cf1-8a4e-4831-878b-c5608b6ad32e tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:14.835685 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-67527cf1-8a4e-4831-878b-c5608b6ad32e tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:14.836451 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-67527cf1-8a4e-4831-878b-c5608b6ad32e tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:14.836919 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-67527cf1-8a4e-4831-878b-c5608b6ad32e tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:14.961432 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-67527cf1-8a4e-4831-878b-c5608b6ad32e tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:14.968763 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-67527cf1-8a4e-4831-878b-c5608b6ad32e tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/2af1ff2e-191e-467e-b95d-1bc5f35d7e15" status: 200 len: 1364 microversion: 2.1 time: 0.144441 May 04 19:12:14.974098 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 414/815] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:12:14 2022] GET /compute/v2.1/servers/2af1ff2e-191e-467e-b95d-1bc5f35d7e15 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:12:15.069840 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-3effbb9a-bdf1-4c18-8332-b7730a1922c8 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:15.070438 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-3effbb9a-bdf1-4c18-8332-b7730a1922c8 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 150304bb-d8d1-4c08-93b6-fc07c69fd846] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:15.077766 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3effbb9a-bdf1-4c18-8332-b7730a1922c8 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:15.078210 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3effbb9a-bdf1-4c18-8332-b7730a1922c8 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:15.079021 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3effbb9a-bdf1-4c18-8332-b7730a1922c8 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:15.079395 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3effbb9a-bdf1-4c18-8332-b7730a1922c8 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:15.108291 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3effbb9a-bdf1-4c18-8332-b7730a1922c8 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:15.108720 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3effbb9a-bdf1-4c18-8332-b7730a1922c8 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:15.109157 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.objects.instance [None req-3effbb9a-bdf1-4c18-8332-b7730a1922c8 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lazy-loading 'fault' on Instance uuid 150304bb-d8d1-4c08-93b6-fc07c69fd846 {{(pid=117125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 04 19:12:15.148669 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-3effbb9a-bdf1-4c18-8332-b7730a1922c8 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:15.155893 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-3effbb9a-bdf1-4c18-8332-b7730a1922c8 tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846" status: 200 len: 1311 microversion: 2.1 time: 0.089850 May 04 19:12:15.156451 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 402/816] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:12:15 2022] GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846 => generated 1311 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:12:15.706060 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-e3c0144d-a2a3-4dfe-a5a6-71423564b225 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:15.706669 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-e3c0144d-a2a3-4dfe-a5a6-71423564b225 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:15.713221 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e3c0144d-a2a3-4dfe-a5a6-71423564b225 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:15.713722 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e3c0144d-a2a3-4dfe-a5a6-71423564b225 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:15.714491 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e3c0144d-a2a3-4dfe-a5a6-71423564b225 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:15.714930 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e3c0144d-a2a3-4dfe-a5a6-71423564b225 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:15.840076 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-e3c0144d-a2a3-4dfe-a5a6-71423564b225 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:15.847709 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-e3c0144d-a2a3-4dfe-a5a6-71423564b225 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:15.849207 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-e3c0144d-a2a3-4dfe-a5a6-71423564b225 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:15.850390 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-e3c0144d-a2a3-4dfe-a5a6-71423564b225 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1721 microversion: 2.20 time: 0.148287 May 04 19:12:15.850950 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 415/817] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:12:15 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:12:15.985728 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-78e7d2e2-c178-4f72-ade7-a3728ea00483 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:15.986403 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-78e7d2e2-c178-4f72-ade7-a3728ea00483 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 2af1ff2e-191e-467e-b95d-1bc5f35d7e15] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:15.993129 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-78e7d2e2-c178-4f72-ade7-a3728ea00483 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:15.993617 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-78e7d2e2-c178-4f72-ade7-a3728ea00483 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:15.994394 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-78e7d2e2-c178-4f72-ade7-a3728ea00483 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:15.994835 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-78e7d2e2-c178-4f72-ade7-a3728ea00483 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:16.127931 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-78e7d2e2-c178-4f72-ade7-a3728ea00483 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:16.136044 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-78e7d2e2-c178-4f72-ade7-a3728ea00483 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/2af1ff2e-191e-467e-b95d-1bc5f35d7e15" status: 200 len: 1364 microversion: 2.1 time: 0.154377 May 04 19:12:16.136771 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 403/818] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:12:15 2022] GET /compute/v2.1/servers/2af1ff2e-191e-467e-b95d-1bc5f35d7e15 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:12:16.172942 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-1e5e404f-d6e1-4636-9972-2905a1cf68fd tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:16.173643 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-1e5e404f-d6e1-4636-9972-2905a1cf68fd tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 150304bb-d8d1-4c08-93b6-fc07c69fd846] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:16.179868 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1e5e404f-d6e1-4636-9972-2905a1cf68fd tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:16.180409 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1e5e404f-d6e1-4636-9972-2905a1cf68fd tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:16.181372 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1e5e404f-d6e1-4636-9972-2905a1cf68fd tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:16.181837 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1e5e404f-d6e1-4636-9972-2905a1cf68fd tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:16.212124 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1e5e404f-d6e1-4636-9972-2905a1cf68fd tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:16.212590 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1e5e404f-d6e1-4636-9972-2905a1cf68fd tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:16.213663 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.objects.instance [None req-1e5e404f-d6e1-4636-9972-2905a1cf68fd tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lazy-loading 'fault' on Instance uuid 150304bb-d8d1-4c08-93b6-fc07c69fd846 {{(pid=117124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 04 19:12:16.253097 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-1e5e404f-d6e1-4636-9972-2905a1cf68fd tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47deb39e5d954424a4fb4e97375443f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5966de1f7fc9403087d0ec08be6a3085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:16.257529 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-dd5c6edc-55f2-4aee-a2d9-c741915b85c4 req-94a05274-9444-4884-ba75-72337c72292b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc9f6260-f308-4f45-809e-40f50eeb47d6", "name": "network-vif-unplugged", "status": "completed", "tag": "7d596d4a-07a6-43a1-bc43-abfd6db7c370"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:12:16.261898 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-1e5e404f-d6e1-4636-9972-2905a1cf68fd tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846" status: 200 len: 1311 microversion: 2.1 time: 0.092819 May 04 19:12:16.272101 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 416/819] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:12:16 2022] GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846 => generated 1311 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:12:16.272493 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-dd5c6edc-55f2-4aee-a2d9-c741915b85c4 req-94a05274-9444-4884-ba75-72337c72292b service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:16.272493 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-dd5c6edc-55f2-4aee-a2d9-c741915b85c4 req-94a05274-9444-4884-ba75-72337c72292b service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:16.279062 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-dd5c6edc-55f2-4aee-a2d9-c741915b85c4 req-94a05274-9444-4884-ba75-72337c72292b service nova] Creating event network-vif-unplugged:7d596d4a-07a6-43a1-bc43-abfd6db7c370 for instance bc9f6260-f308-4f45-809e-40f50eeb47d6 on hv-cinder-83090 May 04 19:12:16.285712 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-dd5c6edc-55f2-4aee-a2d9-c741915b85c4 req-94a05274-9444-4884-ba75-72337c72292b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031430 May 04 19:12:16.286585 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 404/820] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:12:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:12:16.870647 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-e9bc1e8f-c6bb-487a-b88f-2bd5564cbea0 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:16.871297 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-e9bc1e8f-c6bb-487a-b88f-2bd5564cbea0 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:16.879596 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e9bc1e8f-c6bb-487a-b88f-2bd5564cbea0 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:16.880085 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e9bc1e8f-c6bb-487a-b88f-2bd5564cbea0 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:16.880991 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e9bc1e8f-c6bb-487a-b88f-2bd5564cbea0 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:16.881438 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e9bc1e8f-c6bb-487a-b88f-2bd5564cbea0 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:17.076241 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-e9bc1e8f-c6bb-487a-b88f-2bd5564cbea0 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:17.084924 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-e9bc1e8f-c6bb-487a-b88f-2bd5564cbea0 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:17.086561 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-e9bc1e8f-c6bb-487a-b88f-2bd5564cbea0 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:17.088359 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-e9bc1e8f-c6bb-487a-b88f-2bd5564cbea0 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1664 microversion: 2.20 time: 0.222670 May 04 19:12:17.088991 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 417/821] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:12:16 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1664 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:12:17.107985 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-ee9689df-94fc-4add-ae13-e09e3c27840b tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ab9e02ec-6fb3-4e3c-aa56-20c4b93794c3"}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:12:17.109286 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-ee9689df-94fc-4add-ae13-e09e3c27840b tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:17.116040 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ee9689df-94fc-4add-ae13-e09e3c27840b tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:17.116534 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ee9689df-94fc-4add-ae13-e09e3c27840b tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:17.117307 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ee9689df-94fc-4add-ae13-e09e3c27840b tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:17.117761 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ee9689df-94fc-4add-ae13-e09e3c27840b tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:17.152985 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-65925acc-a95e-4517-9476-738fb38bc6f8 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:17.153879 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-65925acc-a95e-4517-9476-738fb38bc6f8 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 2af1ff2e-191e-467e-b95d-1bc5f35d7e15] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:17.161679 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-65925acc-a95e-4517-9476-738fb38bc6f8 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:17.162281 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-65925acc-a95e-4517-9476-738fb38bc6f8 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:17.163308 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-65925acc-a95e-4517-9476-738fb38bc6f8 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:17.163751 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-65925acc-a95e-4517-9476-738fb38bc6f8 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:17.388766 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-ee9689df-94fc-4add-ae13-e09e3c27840b tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "POST /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.286611 May 04 19:12:17.389390 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 405/822] 10.222.0.69 () {62 vars in 1363 bytes} [Wed May 4 19:12:17 2022] POST /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6/os-volume_attachments => generated 188 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 04 19:12:17.394198 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-9c2149b1-e5ec-4b77-9a86-3bdf044b6cfe tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:17.395132 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-9c2149b1-e5ec-4b77-9a86-3bdf044b6cfe tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] [instance: 150304bb-d8d1-4c08-93b6-fc07c69fd846] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:17.401795 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9c2149b1-e5ec-4b77-9a86-3bdf044b6cfe tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:17.402256 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9c2149b1-e5ec-4b77-9a86-3bdf044b6cfe tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:17.403021 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9c2149b1-e5ec-4b77-9a86-3bdf044b6cfe tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:17.403458 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9c2149b1-e5ec-4b77-9a86-3bdf044b6cfe tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:17.417621 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.wsgi [None req-9c2149b1-e5ec-4b77-9a86-3bdf044b6cfe tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] HTTP exception thrown: Instance 150304bb-d8d1-4c08-93b6-fc07c69fd846 could not be found. May 04 19:12:17.418285 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-9c2149b1-e5ec-4b77-9a86-3bdf044b6cfe tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] Returning 404 to user: Instance 150304bb-d8d1-4c08-93b6-fc07c69fd846 could not be found. {{(pid=117125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 04 19:12:17.419105 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-9c2149b1-e5ec-4b77-9a86-3bdf044b6cfe tempest-ServerRescueNegativeTestJSON-165151537 tempest-ServerRescueNegativeTestJSON-165151537-project] 10.222.0.69 "GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846" status: 404 len: 111 microversion: 2.1 time: 0.028722 May 04 19:12:17.419655 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 406/823] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:12:17 2022] GET /compute/v2.1/servers/150304bb-d8d1-4c08-93b6-fc07c69fd846 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 04 19:12:17.522326 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-593b23d5-acc8-4e4a-8d81-91e1a6ab62d5 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:17.522953 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-593b23d5-acc8-4e4a-8d81-91e1a6ab62d5 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:17.529107 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-65925acc-a95e-4517-9476-738fb38bc6f8 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:17.533430 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-593b23d5-acc8-4e4a-8d81-91e1a6ab62d5 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:17.536639 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-65925acc-a95e-4517-9476-738fb38bc6f8 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/2af1ff2e-191e-467e-b95d-1bc5f35d7e15" status: 200 len: 1364 microversion: 2.1 time: 0.388551 May 04 19:12:17.537138 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-593b23d5-acc8-4e4a-8d81-91e1a6ab62d5 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:17.538193 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-593b23d5-acc8-4e4a-8d81-91e1a6ab62d5 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:17.538758 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-593b23d5-acc8-4e4a-8d81-91e1a6ab62d5 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:17.546768 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 418/824] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:12:17 2022] GET /compute/v2.1/servers/2af1ff2e-191e-467e-b95d-1bc5f35d7e15 => generated 1364 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:12:17.785407 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-593b23d5-acc8-4e4a-8d81-91e1a6ab62d5 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "DELETE /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6/os-volume_attachments/ab9e02ec-6fb3-4e3c-aa56-20c4b93794c3" status: 202 len: 0 microversion: 2.20 time: 0.266971 May 04 19:12:17.789121 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 407/825] 10.222.0.69 () {60 vars in 1456 bytes} [Wed May 4 19:12:17 2022] DELETE /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6/os-volume_attachments/ab9e02ec-6fb3-4e3c-aa56-20c4b93794c3 => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 04 19:12:17.840577 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-a33a0a45-479c-4694-b21f-2ad06031e993 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:12:17.841214 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-a33a0a45-479c-4694-b21f-2ad06031e993 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:17.846964 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a33a0a45-479c-4694-b21f-2ad06031e993 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:17.847409 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a33a0a45-479c-4694-b21f-2ad06031e993 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:17.848159 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a33a0a45-479c-4694-b21f-2ad06031e993 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:17.848588 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a33a0a45-479c-4694-b21f-2ad06031e993 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:17.927069 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-a33a0a45-479c-4694-b21f-2ad06031e993 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "POST /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6/action" status: 202 len: 0 microversion: 2.20 time: 0.090015 May 04 19:12:17.927905 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 419/826] 10.222.0.69 () {62 vars in 1318 bytes} [Wed May 4 19:12:17 2022] POST /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 04 19:12:17.938130 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-8a0c4ea4-f77c-4522-9b94-2903330b8662 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:17.938746 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-8a0c4ea4-f77c-4522-9b94-2903330b8662 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:17.958975 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8a0c4ea4-f77c-4522-9b94-2903330b8662 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:17.959638 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8a0c4ea4-f77c-4522-9b94-2903330b8662 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:17.960628 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8a0c4ea4-f77c-4522-9b94-2903330b8662 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:17.961237 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8a0c4ea4-f77c-4522-9b94-2903330b8662 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:18.332633 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-4f12cdb0-ee3d-47af-af85-804926bdc49d req-00c59150-625f-48ae-9a24-75e21fa0ea9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2af1ff2e-191e-467e-b95d-1bc5f35d7e15", "name": "network-vif-plugged", "status": "completed", "tag": "7f533959-c4f2-4e4f-a8ac-4b978c96fb26"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:12:18.341762 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-4f12cdb0-ee3d-47af-af85-804926bdc49d req-00c59150-625f-48ae-9a24-75e21fa0ea9d service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:18.342845 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-4f12cdb0-ee3d-47af-af85-804926bdc49d req-00c59150-625f-48ae-9a24-75e21fa0ea9d service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:18.359349 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-4f12cdb0-ee3d-47af-af85-804926bdc49d req-00c59150-625f-48ae-9a24-75e21fa0ea9d service nova] Creating event network-vif-plugged:7f533959-c4f2-4e4f-a8ac-4b978c96fb26 for instance 2af1ff2e-191e-467e-b95d-1bc5f35d7e15 on hv-cinder-83090 May 04 19:12:18.365730 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-4f12cdb0-ee3d-47af-af85-804926bdc49d req-00c59150-625f-48ae-9a24-75e21fa0ea9d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037095 May 04 19:12:18.366687 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 420/827] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:12:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 04 19:12:18.435818 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-8a0c4ea4-f77c-4522-9b94-2903330b8662 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:18.444279 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-8a0c4ea4-f77c-4522-9b94-2903330b8662 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:18.446054 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-8a0c4ea4-f77c-4522-9b94-2903330b8662 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:18.448123 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-8a0c4ea4-f77c-4522-9b94-2903330b8662 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1672 microversion: 2.20 time: 0.514906 May 04 19:12:18.449159 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 408/828] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:12:17 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1672 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 04 19:12:18.553450 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-4d64a9d4-6cbd-462e-a2b7-578e50eda9ea tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:18.554723 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-4d64a9d4-6cbd-462e-a2b7-578e50eda9ea tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 2af1ff2e-191e-467e-b95d-1bc5f35d7e15] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:18.561694 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4d64a9d4-6cbd-462e-a2b7-578e50eda9ea tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:18.562369 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4d64a9d4-6cbd-462e-a2b7-578e50eda9ea tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:18.563302 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4d64a9d4-6cbd-462e-a2b7-578e50eda9ea tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:18.563888 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4d64a9d4-6cbd-462e-a2b7-578e50eda9ea tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:18.733973 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-4d64a9d4-6cbd-462e-a2b7-578e50eda9ea tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:18.742146 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-4d64a9d4-6cbd-462e-a2b7-578e50eda9ea tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/2af1ff2e-191e-467e-b95d-1bc5f35d7e15" status: 200 len: 1364 microversion: 2.1 time: 0.192850 May 04 19:12:18.742654 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 421/829] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:12:18 2022] GET /compute/v2.1/servers/2af1ff2e-191e-467e-b95d-1bc5f35d7e15 => generated 1364 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:12:19.466957 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-036ea9ac-a932-463d-b0a6-20fe900501e7 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:19.467641 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-036ea9ac-a932-463d-b0a6-20fe900501e7 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:19.485070 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-036ea9ac-a932-463d-b0a6-20fe900501e7 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:19.485930 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-036ea9ac-a932-463d-b0a6-20fe900501e7 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:19.486418 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-036ea9ac-a932-463d-b0a6-20fe900501e7 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:19.486853 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-036ea9ac-a932-463d-b0a6-20fe900501e7 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:19.714523 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-036ea9ac-a932-463d-b0a6-20fe900501e7 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:19.722550 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-036ea9ac-a932-463d-b0a6-20fe900501e7 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:19.724053 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-036ea9ac-a932-463d-b0a6-20fe900501e7 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:19.725263 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-036ea9ac-a932-463d-b0a6-20fe900501e7 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1730 microversion: 2.20 time: 0.262650 May 04 19:12:19.725852 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 409/830] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:12:19 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1730 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:12:19.761423 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-8b9acc01-9efb-43ab-b1c6-bebd2e277fc4 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:19.763425 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-8b9acc01-9efb-43ab-b1c6-bebd2e277fc4 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 2af1ff2e-191e-467e-b95d-1bc5f35d7e15] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:19.772249 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8b9acc01-9efb-43ab-b1c6-bebd2e277fc4 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:19.772921 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8b9acc01-9efb-43ab-b1c6-bebd2e277fc4 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:19.774337 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8b9acc01-9efb-43ab-b1c6-bebd2e277fc4 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:19.774930 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8b9acc01-9efb-43ab-b1c6-bebd2e277fc4 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:19.955401 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-8b9acc01-9efb-43ab-b1c6-bebd2e277fc4 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:19.977612 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-8b9acc01-9efb-43ab-b1c6-bebd2e277fc4 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/2af1ff2e-191e-467e-b95d-1bc5f35d7e15" status: 200 len: 1364 microversion: 2.1 time: 0.221824 May 04 19:12:19.978810 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 422/831] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:12:19 2022] GET /compute/v2.1/servers/2af1ff2e-191e-467e-b95d-1bc5f35d7e15 => generated 1364 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:12:20.747121 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-e96c3358-15e6-4954-9722-4df26deb8d1d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:20.760395 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-e96c3358-15e6-4954-9722-4df26deb8d1d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:20.777664 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e96c3358-15e6-4954-9722-4df26deb8d1d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:20.778366 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e96c3358-15e6-4954-9722-4df26deb8d1d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:20.779149 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e96c3358-15e6-4954-9722-4df26deb8d1d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:20.780416 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e96c3358-15e6-4954-9722-4df26deb8d1d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:20.989903 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-e96c3358-15e6-4954-9722-4df26deb8d1d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:20.995669 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-04cb5cc0-215b-47c1-b08f-6fc7fabecb98 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:20.996418 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-04cb5cc0-215b-47c1-b08f-6fc7fabecb98 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 2af1ff2e-191e-467e-b95d-1bc5f35d7e15] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:20.997058 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-e96c3358-15e6-4954-9722-4df26deb8d1d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:20.998586 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-e96c3358-15e6-4954-9722-4df26deb8d1d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:20.999892 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-e96c3358-15e6-4954-9722-4df26deb8d1d tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1730 microversion: 2.20 time: 0.259838 May 04 19:12:21.003323 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-04cb5cc0-215b-47c1-b08f-6fc7fabecb98 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:21.004012 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-04cb5cc0-215b-47c1-b08f-6fc7fabecb98 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:21.005005 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-04cb5cc0-215b-47c1-b08f-6fc7fabecb98 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:21.005820 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-04cb5cc0-215b-47c1-b08f-6fc7fabecb98 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:21.011436 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 410/832] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:12:20 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1730 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:12:21.236456 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-04cb5cc0-215b-47c1-b08f-6fc7fabecb98 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:21.244955 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-04cb5cc0-215b-47c1-b08f-6fc7fabecb98 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/2af1ff2e-191e-467e-b95d-1bc5f35d7e15" status: 200 len: 1555 microversion: 2.1 time: 0.254844 May 04 19:12:21.245641 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 423/833] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:12:20 2022] GET /compute/v2.1/servers/2af1ff2e-191e-467e-b95d-1bc5f35d7e15 => generated 1555 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:12:21.264328 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-822a1c5f-fa5f-445a-811c-8c46de33274c tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:21.264818 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-822a1c5f-fa5f-445a-811c-8c46de33274c tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 2af1ff2e-191e-467e-b95d-1bc5f35d7e15] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:21.271470 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-822a1c5f-fa5f-445a-811c-8c46de33274c tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:21.271913 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-822a1c5f-fa5f-445a-811c-8c46de33274c tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:21.272862 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-822a1c5f-fa5f-445a-811c-8c46de33274c tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:21.273302 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-822a1c5f-fa5f-445a-811c-8c46de33274c tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:21.363252 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-822a1c5f-fa5f-445a-811c-8c46de33274c tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/2af1ff2e-191e-467e-b95d-1bc5f35d7e15/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.105592 May 04 19:12:21.364355 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 411/834] 10.222.0.69 () {58 vars in 1274 bytes} [Wed May 4 19:12:21 2022] GET /compute/v2.1/servers/2af1ff2e-191e-467e-b95d-1bc5f35d7e15/os-interface => generated 285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 04 19:12:22.018042 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-ac0b445e-0a21-404b-ac35-366ad49bdf1b tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:22.018706 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-ac0b445e-0a21-404b-ac35-366ad49bdf1b tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:22.025165 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ac0b445e-0a21-404b-ac35-366ad49bdf1b tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:22.025433 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ac0b445e-0a21-404b-ac35-366ad49bdf1b tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:22.026249 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ac0b445e-0a21-404b-ac35-366ad49bdf1b tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:22.028047 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ac0b445e-0a21-404b-ac35-366ad49bdf1b tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:22.189889 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-ac0b445e-0a21-404b-ac35-366ad49bdf1b tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:22.208393 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-ac0b445e-0a21-404b-ac35-366ad49bdf1b tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:22.210144 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-ac0b445e-0a21-404b-ac35-366ad49bdf1b tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:22.211444 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-ac0b445e-0a21-404b-ac35-366ad49bdf1b tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1730 microversion: 2.20 time: 0.197484 May 04 19:12:22.212719 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 424/835] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:12:22 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1730 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:12:22.438005 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-64db12e3-94a1-4d7c-ab8e-7215d8037b6e tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:22.439100 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-64db12e3-94a1-4d7c-ab8e-7215d8037b6e tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: c0ca0b46-570c-45ff-820a-87a4197033f3] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:22.473917 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-64db12e3-94a1-4d7c-ab8e-7215d8037b6e tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:22.475191 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-64db12e3-94a1-4d7c-ab8e-7215d8037b6e tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:22.477263 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-64db12e3-94a1-4d7c-ab8e-7215d8037b6e tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:22.478733 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-64db12e3-94a1-4d7c-ab8e-7215d8037b6e tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:22.547984 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-64db12e3-94a1-4d7c-ab8e-7215d8037b6e tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/c0ca0b46-570c-45ff-820a-87a4197033f3/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.114786 May 04 19:12:22.567715 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 412/836] 10.222.0.69 () {58 vars in 1301 bytes} [Wed May 4 19:12:22 2022] GET /compute/v2.1/servers/c0ca0b46-570c-45ff-820a-87a4197033f3/os-volume_attachments => generated 371 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:12:22.698269 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-7da66a5e-032c-46f8-af13-d05dcfa5c595 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:22.698778 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-7da66a5e-032c-46f8-af13-d05dcfa5c595 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: c0ca0b46-570c-45ff-820a-87a4197033f3] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:22.706669 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7da66a5e-032c-46f8-af13-d05dcfa5c595 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:22.707336 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7da66a5e-032c-46f8-af13-d05dcfa5c595 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:22.708441 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7da66a5e-032c-46f8-af13-d05dcfa5c595 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:22.709241 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7da66a5e-032c-46f8-af13-d05dcfa5c595 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:22.747697 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-7da66a5e-032c-46f8-af13-d05dcfa5c595 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/c0ca0b46-570c-45ff-820a-87a4197033f3/os-volume_attachments/06ed7258-b5fb-4dff-b0b5-58098a97e74d" status: 200 len: 194 microversion: 2.1 time: 0.054536 May 04 19:12:22.749688 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 425/837] 10.222.0.69 () {58 vars in 1412 bytes} [Wed May 4 19:12:22 2022] GET /compute/v2.1/servers/c0ca0b46-570c-45ff-820a-87a4197033f3/os-volume_attachments/06ed7258-b5fb-4dff-b0b5-58098a97e74d => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:12:22.762067 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-fdbf14bb-0622-43d7-96a6-1dd5588aa1a4 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:22.763030 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-fdbf14bb-0622-43d7-96a6-1dd5588aa1a4 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: c0ca0b46-570c-45ff-820a-87a4197033f3] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:22.775715 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-fdbf14bb-0622-43d7-96a6-1dd5588aa1a4 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:22.777457 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-fdbf14bb-0622-43d7-96a6-1dd5588aa1a4 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:22.779758 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-fdbf14bb-0622-43d7-96a6-1dd5588aa1a4 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:22.782242 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-fdbf14bb-0622-43d7-96a6-1dd5588aa1a4 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:22.933130 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.objects.instance [None req-fdbf14bb-0622-43d7-96a6-1dd5588aa1a4 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lazy-loading 'services' on Instance uuid c0ca0b46-570c-45ff-820a-87a4197033f3 {{(pid=117125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 04 19:12:22.967776 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-f8798fca-83df-4bc1-95e8-bef68cd9c11f req-2f2d7372-4567-4399-a05d-43827d3381d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2af1ff2e-191e-467e-b95d-1bc5f35d7e15", "tag": "7f533959-c4f2-4e4f-a8ac-4b978c96fb26"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:12:22.995692 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-f8798fca-83df-4bc1-95e8-bef68cd9c11f req-2f2d7372-4567-4399-a05d-43827d3381d9 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:22.996397 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-f8798fca-83df-4bc1-95e8-bef68cd9c11f req-2f2d7372-4567-4399-a05d-43827d3381d9 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:23.014516 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-f8798fca-83df-4bc1-95e8-bef68cd9c11f req-2f2d7372-4567-4399-a05d-43827d3381d9 service nova] Creating event network-changed:7f533959-c4f2-4e4f-a8ac-4b978c96fb26 for instance 2af1ff2e-191e-467e-b95d-1bc5f35d7e15 on hv-cinder-83090 May 04 19:12:23.021827 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-f8798fca-83df-4bc1-95e8-bef68cd9c11f req-2f2d7372-4567-4399-a05d-43827d3381d9 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068883 May 04 19:12:23.023494 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 426/838] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:12:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:12:23.047259 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-fdbf14bb-0622-43d7-96a6-1dd5588aa1a4 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "DELETE /compute/v2.1/servers/c0ca0b46-570c-45ff-820a-87a4197033f3/os-volume_attachments/06ed7258-b5fb-4dff-b0b5-58098a97e74d" status: 202 len: 0 microversion: 2.1 time: 0.291746 May 04 19:12:23.048573 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 413/839] 10.222.0.69 () {58 vars in 1415 bytes} [Wed May 4 19:12:22 2022] DELETE /compute/v2.1/servers/c0ca0b46-570c-45ff-820a-87a4197033f3/os-volume_attachments/06ed7258-b5fb-4dff-b0b5-58098a97e74d => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 04 19:12:23.230039 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-76c746df-4b8f-426d-a868-fbfbe14fa533 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:23.230755 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-76c746df-4b8f-426d-a868-fbfbe14fa533 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:23.245640 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-76c746df-4b8f-426d-a868-fbfbe14fa533 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:23.246401 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-76c746df-4b8f-426d-a868-fbfbe14fa533 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:23.247352 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-76c746df-4b8f-426d-a868-fbfbe14fa533 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:23.247951 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-76c746df-4b8f-426d-a868-fbfbe14fa533 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:23.498679 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-76c746df-4b8f-426d-a868-fbfbe14fa533 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:23.507155 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-76c746df-4b8f-426d-a868-fbfbe14fa533 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:23.511742 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-76c746df-4b8f-426d-a868-fbfbe14fa533 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:23.515460 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-76c746df-4b8f-426d-a868-fbfbe14fa533 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1730 microversion: 2.20 time: 0.289369 May 04 19:12:23.516194 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 427/840] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:12:23 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1730 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:12:24.534656 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-49a5735c-8508-4d3c-b6ad-66febf934f46 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:24.536127 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-49a5735c-8508-4d3c-b6ad-66febf934f46 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:24.543047 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-49a5735c-8508-4d3c-b6ad-66febf934f46 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:24.543776 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-49a5735c-8508-4d3c-b6ad-66febf934f46 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:24.544734 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-49a5735c-8508-4d3c-b6ad-66febf934f46 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:24.545391 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-49a5735c-8508-4d3c-b6ad-66febf934f46 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:24.726076 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-49a5735c-8508-4d3c-b6ad-66febf934f46 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:24.734360 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-49a5735c-8508-4d3c-b6ad-66febf934f46 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:24.736134 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-49a5735c-8508-4d3c-b6ad-66febf934f46 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:24.737559 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-49a5735c-8508-4d3c-b6ad-66febf934f46 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1730 microversion: 2.20 time: 0.207965 May 04 19:12:24.738635 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 414/841] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:12:24 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1730 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:12:25.758245 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-40a14c90-eef6-4376-a500-4e3653b73c55 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:25.759034 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-40a14c90-eef6-4376-a500-4e3653b73c55 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:25.767184 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-40a14c90-eef6-4376-a500-4e3653b73c55 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:25.767708 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-40a14c90-eef6-4376-a500-4e3653b73c55 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:25.768565 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-40a14c90-eef6-4376-a500-4e3653b73c55 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:25.769083 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-40a14c90-eef6-4376-a500-4e3653b73c55 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:25.948210 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-40a14c90-eef6-4376-a500-4e3653b73c55 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:25.958626 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-40a14c90-eef6-4376-a500-4e3653b73c55 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:25.960401 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-40a14c90-eef6-4376-a500-4e3653b73c55 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:25.961804 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-40a14c90-eef6-4376-a500-4e3653b73c55 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1730 microversion: 2.20 time: 0.209323 May 04 19:12:25.975836 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 428/842] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:12:25 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1730 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:12:26.984944 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-fb822445-f0d9-43dd-bbe5-fb6065407f22 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:26.985692 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-fb822445-f0d9-43dd-bbe5-fb6065407f22 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:26.992378 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-fb822445-f0d9-43dd-bbe5-fb6065407f22 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:26.992836 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-fb822445-f0d9-43dd-bbe5-fb6065407f22 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:26.993689 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-fb822445-f0d9-43dd-bbe5-fb6065407f22 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:26.994134 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-fb822445-f0d9-43dd-bbe5-fb6065407f22 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:27.132292 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-fb822445-f0d9-43dd-bbe5-fb6065407f22 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:27.142729 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-fb822445-f0d9-43dd-bbe5-fb6065407f22 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:27.144260 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-fb822445-f0d9-43dd-bbe5-fb6065407f22 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:27.145444 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-fb822445-f0d9-43dd-bbe5-fb6065407f22 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1730 microversion: 2.20 time: 0.164680 May 04 19:12:27.156387 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 415/843] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:12:26 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:12:28.165024 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-d2264525-f3ca-49b4-b326-6c84affc1b79 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:28.166262 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-d2264525-f3ca-49b4-b326-6c84affc1b79 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:28.172604 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d2264525-f3ca-49b4-b326-6c84affc1b79 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:28.173082 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d2264525-f3ca-49b4-b326-6c84affc1b79 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:28.173886 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d2264525-f3ca-49b4-b326-6c84affc1b79 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:28.174324 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d2264525-f3ca-49b4-b326-6c84affc1b79 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:28.314804 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-d2264525-f3ca-49b4-b326-6c84affc1b79 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:28.323109 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-d2264525-f3ca-49b4-b326-6c84affc1b79 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:28.324609 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-d2264525-f3ca-49b4-b326-6c84affc1b79 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:28.325818 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-d2264525-f3ca-49b4-b326-6c84affc1b79 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1730 microversion: 2.20 time: 0.165451 May 04 19:12:28.326383 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 429/844] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:12:28 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:12:29.344316 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-d1b75db2-8308-4bf8-a559-32f4101ad661 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:29.345032 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-d1b75db2-8308-4bf8-a559-32f4101ad661 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:29.351921 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d1b75db2-8308-4bf8-a559-32f4101ad661 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:29.352654 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d1b75db2-8308-4bf8-a559-32f4101ad661 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:29.354179 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d1b75db2-8308-4bf8-a559-32f4101ad661 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:29.354612 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-d1b75db2-8308-4bf8-a559-32f4101ad661 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:29.498524 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-d1b75db2-8308-4bf8-a559-32f4101ad661 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:29.506378 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-d1b75db2-8308-4bf8-a559-32f4101ad661 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:29.507893 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-d1b75db2-8308-4bf8-a559-32f4101ad661 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:29.509621 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-d1b75db2-8308-4bf8-a559-32f4101ad661 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1730 microversion: 2.20 time: 0.168708 May 04 19:12:29.510198 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 416/845] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:12:29 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:12:30.531038 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-4bc39c40-ac19-489f-9822-513a849b4c62 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:30.531693 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-4bc39c40-ac19-489f-9822-513a849b4c62 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:30.538146 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4bc39c40-ac19-489f-9822-513a849b4c62 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:30.538739 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4bc39c40-ac19-489f-9822-513a849b4c62 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:30.539517 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4bc39c40-ac19-489f-9822-513a849b4c62 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:30.539956 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4bc39c40-ac19-489f-9822-513a849b4c62 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:30.668999 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-4bc39c40-ac19-489f-9822-513a849b4c62 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:30.677454 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-4bc39c40-ac19-489f-9822-513a849b4c62 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:30.679207 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-4bc39c40-ac19-489f-9822-513a849b4c62 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:30.680477 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-4bc39c40-ac19-489f-9822-513a849b4c62 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1730 microversion: 2.20 time: 0.154216 May 04 19:12:30.682747 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 430/846] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:12:30 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:12:31.699348 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-b2dd6264-1aac-4d03-9a68-20aaa6e58ee2 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:31.699955 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-b2dd6264-1aac-4d03-9a68-20aaa6e58ee2 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:31.706212 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b2dd6264-1aac-4d03-9a68-20aaa6e58ee2 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:31.706660 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b2dd6264-1aac-4d03-9a68-20aaa6e58ee2 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:31.707417 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b2dd6264-1aac-4d03-9a68-20aaa6e58ee2 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:31.707851 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b2dd6264-1aac-4d03-9a68-20aaa6e58ee2 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:31.835701 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-b2dd6264-1aac-4d03-9a68-20aaa6e58ee2 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:31.844305 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-b2dd6264-1aac-4d03-9a68-20aaa6e58ee2 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:31.845872 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-b2dd6264-1aac-4d03-9a68-20aaa6e58ee2 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:31.847030 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-b2dd6264-1aac-4d03-9a68-20aaa6e58ee2 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1730 microversion: 2.20 time: 0.151544 May 04 19:12:31.847595 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 417/847] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:12:31 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:12:32.865685 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-6b448f79-db6e-4510-984d-4a29d6693e0c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:32.866283 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-6b448f79-db6e-4510-984d-4a29d6693e0c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:32.873004 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6b448f79-db6e-4510-984d-4a29d6693e0c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:32.873446 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6b448f79-db6e-4510-984d-4a29d6693e0c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:32.874224 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6b448f79-db6e-4510-984d-4a29d6693e0c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:32.874657 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6b448f79-db6e-4510-984d-4a29d6693e0c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:33.004319 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-6b448f79-db6e-4510-984d-4a29d6693e0c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:33.012583 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-6b448f79-db6e-4510-984d-4a29d6693e0c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:33.014109 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-6b448f79-db6e-4510-984d-4a29d6693e0c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:33.015244 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-6b448f79-db6e-4510-984d-4a29d6693e0c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1730 microversion: 2.20 time: 0.153482 May 04 19:12:33.015790 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 431/848] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:12:32 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:12:33.736993 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-1c05af09-a62f-4ce5-b686-2e687d7be61c tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:33.737540 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-1c05af09-a62f-4ce5-b686-2e687d7be61c tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: c0ca0b46-570c-45ff-820a-87a4197033f3] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:33.744518 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1c05af09-a62f-4ce5-b686-2e687d7be61c tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:33.744977 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1c05af09-a62f-4ce5-b686-2e687d7be61c tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:33.745769 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1c05af09-a62f-4ce5-b686-2e687d7be61c tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:33.746206 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1c05af09-a62f-4ce5-b686-2e687d7be61c tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:33.775450 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-1c05af09-a62f-4ce5-b686-2e687d7be61c tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/c0ca0b46-570c-45ff-820a-87a4197033f3/os-volume_attachments/3cf936ae-3e42-46ce-8c9d-1d487aaccf97" status: 200 len: 194 microversion: 2.1 time: 0.041933 May 04 19:12:33.776032 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 418/849] 10.222.0.69 () {58 vars in 1412 bytes} [Wed May 4 19:12:33 2022] GET /compute/v2.1/servers/c0ca0b46-570c-45ff-820a-87a4197033f3/os-volume_attachments/3cf936ae-3e42-46ce-8c9d-1d487aaccf97 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:12:33.786147 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-836f5a58-3813-489a-8f35-276a3ff1550b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:33.786638 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-836f5a58-3813-489a-8f35-276a3ff1550b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: c0ca0b46-570c-45ff-820a-87a4197033f3] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:33.793050 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-836f5a58-3813-489a-8f35-276a3ff1550b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:33.793525 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-836f5a58-3813-489a-8f35-276a3ff1550b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:33.794281 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-836f5a58-3813-489a-8f35-276a3ff1550b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:33.794710 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-836f5a58-3813-489a-8f35-276a3ff1550b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:33.870611 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.objects.instance [None req-836f5a58-3813-489a-8f35-276a3ff1550b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lazy-loading 'services' on Instance uuid c0ca0b46-570c-45ff-820a-87a4197033f3 {{(pid=117124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 04 19:12:33.937805 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-836f5a58-3813-489a-8f35-276a3ff1550b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "DELETE /compute/v2.1/servers/c0ca0b46-570c-45ff-820a-87a4197033f3/os-volume_attachments/3cf936ae-3e42-46ce-8c9d-1d487aaccf97" status: 202 len: 0 microversion: 2.1 time: 0.155713 May 04 19:12:33.938409 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 432/850] 10.222.0.69 () {58 vars in 1415 bytes} [Wed May 4 19:12:33 2022] DELETE /compute/v2.1/servers/c0ca0b46-570c-45ff-820a-87a4197033f3/os-volume_attachments/3cf936ae-3e42-46ce-8c9d-1d487aaccf97 => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 04 19:12:34.033177 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-dfc8afb3-0b6d-4615-89e9-8a6fc4e5cbf9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:34.033889 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-dfc8afb3-0b6d-4615-89e9-8a6fc4e5cbf9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:34.039977 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-dfc8afb3-0b6d-4615-89e9-8a6fc4e5cbf9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:34.040487 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-dfc8afb3-0b6d-4615-89e9-8a6fc4e5cbf9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:34.041283 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-dfc8afb3-0b6d-4615-89e9-8a6fc4e5cbf9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:34.041831 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-dfc8afb3-0b6d-4615-89e9-8a6fc4e5cbf9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:34.169580 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-dfc8afb3-0b6d-4615-89e9-8a6fc4e5cbf9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:34.177220 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-dfc8afb3-0b6d-4615-89e9-8a6fc4e5cbf9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:34.178744 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-dfc8afb3-0b6d-4615-89e9-8a6fc4e5cbf9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:34.179876 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-dfc8afb3-0b6d-4615-89e9-8a6fc4e5cbf9 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1730 microversion: 2.20 time: 0.150613 May 04 19:12:34.180423 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 419/851] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:12:34 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:12:35.092673 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-89296ea1-5ff0-4cbe-ba0e-1422a5b976d5 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:35.093715 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-89296ea1-5ff0-4cbe-ba0e-1422a5b976d5 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: c0ca0b46-570c-45ff-820a-87a4197033f3] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:35.099647 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-89296ea1-5ff0-4cbe-ba0e-1422a5b976d5 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:35.100088 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-89296ea1-5ff0-4cbe-ba0e-1422a5b976d5 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:35.100834 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-89296ea1-5ff0-4cbe-ba0e-1422a5b976d5 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:35.101265 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-89296ea1-5ff0-4cbe-ba0e-1422a5b976d5 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:35.128728 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-89296ea1-5ff0-4cbe-ba0e-1422a5b976d5 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/c0ca0b46-570c-45ff-820a-87a4197033f3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040742 May 04 19:12:35.129264 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 433/852] 10.222.0.69 () {58 vars in 1301 bytes} [Wed May 4 19:12:35 2022] GET /compute/v2.1/servers/c0ca0b46-570c-45ff-820a-87a4197033f3/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 04 19:12:35.197835 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-ade97178-cf54-406b-82e4-74c8669f8d5b tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:35.198452 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-ade97178-cf54-406b-82e4-74c8669f8d5b tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:35.204826 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ade97178-cf54-406b-82e4-74c8669f8d5b tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:35.205281 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ade97178-cf54-406b-82e4-74c8669f8d5b tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:35.206079 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ade97178-cf54-406b-82e4-74c8669f8d5b tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:35.206600 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ade97178-cf54-406b-82e4-74c8669f8d5b tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:35.231389 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-46f1bbc5-b7cc-4e35-8447-7fab6a431b71 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:35.232319 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-46f1bbc5-b7cc-4e35-8447-7fab6a431b71 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: c0ca0b46-570c-45ff-820a-87a4197033f3] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:35.238378 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-46f1bbc5-b7cc-4e35-8447-7fab6a431b71 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:35.238826 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-46f1bbc5-b7cc-4e35-8447-7fab6a431b71 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:35.239585 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-46f1bbc5-b7cc-4e35-8447-7fab6a431b71 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:35.240022 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-46f1bbc5-b7cc-4e35-8447-7fab6a431b71 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:35.268123 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-46f1bbc5-b7cc-4e35-8447-7fab6a431b71 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/c0ca0b46-570c-45ff-820a-87a4197033f3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041359 May 04 19:12:35.268694 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 434/853] 10.222.0.69 () {58 vars in 1301 bytes} [Wed May 4 19:12:35 2022] GET /compute/v2.1/servers/c0ca0b46-570c-45ff-820a-87a4197033f3/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 04 19:12:35.325058 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-10a87c87-6f6c-40cc-96e6-02a640a5876c tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:35.325585 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-10a87c87-6f6c-40cc-96e6-02a640a5876c tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: c0ca0b46-570c-45ff-820a-87a4197033f3] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:35.331465 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-10a87c87-6f6c-40cc-96e6-02a640a5876c tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:35.331914 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-10a87c87-6f6c-40cc-96e6-02a640a5876c tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:35.332689 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-10a87c87-6f6c-40cc-96e6-02a640a5876c tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:35.333160 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-10a87c87-6f6c-40cc-96e6-02a640a5876c tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:35.334348 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-ade97178-cf54-406b-82e4-74c8669f8d5b tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:35.342716 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-ade97178-cf54-406b-82e4-74c8669f8d5b tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:35.344214 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-ade97178-cf54-406b-82e4-74c8669f8d5b tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:35.345382 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-ade97178-cf54-406b-82e4-74c8669f8d5b tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1730 microversion: 2.20 time: 0.151372 May 04 19:12:35.345982 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 420/854] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:12:35 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:12:35.362023 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-10a87c87-6f6c-40cc-96e6-02a640a5876c tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: c0ca0b46-570c-45ff-820a-87a4197033f3] Going to try to terminate instance {{(pid=117124) delete /opt/stack/nova/nova/compute/api.py:2664}} May 04 19:12:35.438588 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-10a87c87-6f6c-40cc-96e6-02a640a5876c tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "DELETE /compute/v2.1/servers/c0ca0b46-570c-45ff-820a-87a4197033f3" status: 204 len: 0 microversion: 2.1 time: 0.117241 May 04 19:12:35.439304 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 435/855] 10.222.0.69 () {58 vars in 1238 bytes} [Wed May 4 19:12:35 2022] DELETE /compute/v2.1/servers/c0ca0b46-570c-45ff-820a-87a4197033f3 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 04 19:12:35.449125 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-7cbdead9-8d6f-4783-9501-a075af82d1e6 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:35.449994 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-7cbdead9-8d6f-4783-9501-a075af82d1e6 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: c0ca0b46-570c-45ff-820a-87a4197033f3] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:35.456088 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7cbdead9-8d6f-4783-9501-a075af82d1e6 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:35.456532 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7cbdead9-8d6f-4783-9501-a075af82d1e6 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:35.457288 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7cbdead9-8d6f-4783-9501-a075af82d1e6 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:35.457740 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7cbdead9-8d6f-4783-9501-a075af82d1e6 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:35.587906 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-7cbdead9-8d6f-4783-9501-a075af82d1e6 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:35.595066 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-7cbdead9-8d6f-4783-9501-a075af82d1e6 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/c0ca0b46-570c-45ff-820a-87a4197033f3" status: 200 len: 1676 microversion: 2.1 time: 0.151344 May 04 19:12:35.595624 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 421/856] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:12:35 2022] GET /compute/v2.1/servers/c0ca0b46-570c-45ff-820a-87a4197033f3 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:12:36.339999 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-e2396caf-8fa5-4f70-9c88-8bf02ed2717d req-c5941690-236f-46dd-be5a-c470d793ba83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc9f6260-f308-4f45-809e-40f50eeb47d6", "name": "network-vif-plugged", "status": "completed", "tag": "7d596d4a-07a6-43a1-bc43-abfd6db7c370"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:12:36.348540 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-e2396caf-8fa5-4f70-9c88-8bf02ed2717d req-c5941690-236f-46dd-be5a-c470d793ba83 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:36.349094 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-e2396caf-8fa5-4f70-9c88-8bf02ed2717d req-c5941690-236f-46dd-be5a-c470d793ba83 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:36.361866 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-e2396caf-8fa5-4f70-9c88-8bf02ed2717d req-c5941690-236f-46dd-be5a-c470d793ba83 service nova] Creating event network-vif-plugged:7d596d4a-07a6-43a1-bc43-abfd6db7c370 for instance bc9f6260-f308-4f45-809e-40f50eeb47d6 on hv-cinder-83090 May 04 19:12:36.364370 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-ced95837-452e-4f8e-8ee8-77aee133d1fb tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:36.366690 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-ced95837-452e-4f8e-8ee8-77aee133d1fb tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:36.367115 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-e2396caf-8fa5-4f70-9c88-8bf02ed2717d req-c5941690-236f-46dd-be5a-c470d793ba83 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031092 May 04 19:12:36.367969 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 436/857] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:12:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:12:36.374075 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ced95837-452e-4f8e-8ee8-77aee133d1fb tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:36.374629 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ced95837-452e-4f8e-8ee8-77aee133d1fb tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:36.375351 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ced95837-452e-4f8e-8ee8-77aee133d1fb tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:36.375735 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ced95837-452e-4f8e-8ee8-77aee133d1fb tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:36.504449 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-ced95837-452e-4f8e-8ee8-77aee133d1fb tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:36.512079 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-ced95837-452e-4f8e-8ee8-77aee133d1fb tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:36.513590 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-ced95837-452e-4f8e-8ee8-77aee133d1fb tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:36.514725 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-ced95837-452e-4f8e-8ee8-77aee133d1fb tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1730 microversion: 2.20 time: 0.154575 May 04 19:12:36.515278 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 422/858] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:12:36 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 04 19:12:36.612706 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-8d795a44-e5eb-468a-8341-6fd8a8c9bd8d tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:36.613398 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-8d795a44-e5eb-468a-8341-6fd8a8c9bd8d tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: c0ca0b46-570c-45ff-820a-87a4197033f3] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:36.619546 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8d795a44-e5eb-468a-8341-6fd8a8c9bd8d tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:36.619990 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8d795a44-e5eb-468a-8341-6fd8a8c9bd8d tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:36.620755 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8d795a44-e5eb-468a-8341-6fd8a8c9bd8d tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:36.621187 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8d795a44-e5eb-468a-8341-6fd8a8c9bd8d tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:36.755089 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-8d795a44-e5eb-468a-8341-6fd8a8c9bd8d tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:36.762416 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-8d795a44-e5eb-468a-8341-6fd8a8c9bd8d tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/c0ca0b46-570c-45ff-820a-87a4197033f3" status: 200 len: 1676 microversion: 2.1 time: 0.153948 May 04 19:12:36.762990 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 437/859] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:12:36 2022] GET /compute/v2.1/servers/c0ca0b46-570c-45ff-820a-87a4197033f3 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:12:37.533583 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-e2ae76e6-9d65-492f-b0ec-e20f65325b6c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:37.534281 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-e2ae76e6-9d65-492f-b0ec-e20f65325b6c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:37.540401 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e2ae76e6-9d65-492f-b0ec-e20f65325b6c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:37.540845 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e2ae76e6-9d65-492f-b0ec-e20f65325b6c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:37.541660 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e2ae76e6-9d65-492f-b0ec-e20f65325b6c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:37.542095 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e2ae76e6-9d65-492f-b0ec-e20f65325b6c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:37.670862 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-e2ae76e6-9d65-492f-b0ec-e20f65325b6c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:37.679142 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-e2ae76e6-9d65-492f-b0ec-e20f65325b6c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:37.681254 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-e2ae76e6-9d65-492f-b0ec-e20f65325b6c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:37.682495 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-e2ae76e6-9d65-492f-b0ec-e20f65325b6c tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1730 microversion: 2.20 time: 0.152781 May 04 19:12:37.682989 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 423/860] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:12:37 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:12:37.779795 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-04142ef2-b850-4a05-aee6-0bf3d845425b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:37.780497 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-04142ef2-b850-4a05-aee6-0bf3d845425b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: c0ca0b46-570c-45ff-820a-87a4197033f3] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:37.786747 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-04142ef2-b850-4a05-aee6-0bf3d845425b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:37.787214 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-04142ef2-b850-4a05-aee6-0bf3d845425b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:37.787959 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-04142ef2-b850-4a05-aee6-0bf3d845425b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:37.788395 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-04142ef2-b850-4a05-aee6-0bf3d845425b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:37.971184 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-04142ef2-b850-4a05-aee6-0bf3d845425b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:37.979434 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-04142ef2-b850-4a05-aee6-0bf3d845425b tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/c0ca0b46-570c-45ff-820a-87a4197033f3" status: 200 len: 1676 microversion: 2.1 time: 0.203429 May 04 19:12:37.988528 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 438/861] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:12:37 2022] GET /compute/v2.1/servers/c0ca0b46-570c-45ff-820a-87a4197033f3 => generated 1676 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:12:38.626050 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-9b9f68e8-04f6-49bb-95c8-4e7131e6969f req-5dcaf2ac-deae-4c9c-8d35-46d3db1500f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0ca0b46-570c-45ff-820a-87a4197033f3", "name": "network-vif-deleted", "tag": "24608008-ae36-4f07-bcff-72a1c2a095b8"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:12:38.640857 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-9b9f68e8-04f6-49bb-95c8-4e7131e6969f req-5dcaf2ac-deae-4c9c-8d35-46d3db1500f7 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:38.643443 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-9b9f68e8-04f6-49bb-95c8-4e7131e6969f req-5dcaf2ac-deae-4c9c-8d35-46d3db1500f7 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:38.666875 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-9b9f68e8-04f6-49bb-95c8-4e7131e6969f req-5dcaf2ac-deae-4c9c-8d35-46d3db1500f7 service nova] Creating event network-vif-deleted:24608008-ae36-4f07-bcff-72a1c2a095b8 for instance c0ca0b46-570c-45ff-820a-87a4197033f3 on hv-cinder-83090 May 04 19:12:38.674972 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-9b9f68e8-04f6-49bb-95c8-4e7131e6969f req-5dcaf2ac-deae-4c9c-8d35-46d3db1500f7 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052720 May 04 19:12:38.676123 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 424/862] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:12:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:12:38.700921 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-b0da4937-bfa4-4116-b296-d2d07c463fca tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:38.701673 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-b0da4937-bfa4-4116-b296-d2d07c463fca tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:38.707659 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b0da4937-bfa4-4116-b296-d2d07c463fca tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:38.708112 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b0da4937-bfa4-4116-b296-d2d07c463fca tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:38.708893 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b0da4937-bfa4-4116-b296-d2d07c463fca tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:38.709346 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b0da4937-bfa4-4116-b296-d2d07c463fca tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:38.843230 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-b0da4937-bfa4-4116-b296-d2d07c463fca tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:38.851856 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-b0da4937-bfa4-4116-b296-d2d07c463fca tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:38.853795 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-b0da4937-bfa4-4116-b296-d2d07c463fca tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:38.855312 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-b0da4937-bfa4-4116-b296-d2d07c463fca tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1730 microversion: 2.20 time: 0.159200 May 04 19:12:38.856012 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 439/863] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:12:38 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:12:38.997888 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-fa65425f-9d82-4f39-ad2e-e42771fc4f4d tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:38.998699 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-fa65425f-9d82-4f39-ad2e-e42771fc4f4d tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: c0ca0b46-570c-45ff-820a-87a4197033f3] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:39.006719 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-fa65425f-9d82-4f39-ad2e-e42771fc4f4d tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:39.007160 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-fa65425f-9d82-4f39-ad2e-e42771fc4f4d tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:39.008193 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-fa65425f-9d82-4f39-ad2e-e42771fc4f4d tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:39.008586 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-fa65425f-9d82-4f39-ad2e-e42771fc4f4d tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:39.076582 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-fa65425f-9d82-4f39-ad2e-e42771fc4f4d tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54ad9809c8241a18d88fa6cd960badd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8f18c943e24a3ab621f08fa24c596b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:39.084866 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-fa65425f-9d82-4f39-ad2e-e42771fc4f4d tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/c0ca0b46-570c-45ff-820a-87a4197033f3" status: 200 len: 1608 microversion: 2.1 time: 0.092139 May 04 19:12:39.086084 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 425/864] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:12:38 2022] GET /compute/v2.1/servers/c0ca0b46-570c-45ff-820a-87a4197033f3 => generated 1608 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:12:39.873601 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-dca44518-d1df-4a61-b43f-394bcce90619 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:39.874246 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-dca44518-d1df-4a61-b43f-394bcce90619 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:39.880641 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-dca44518-d1df-4a61-b43f-394bcce90619 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:39.881081 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-dca44518-d1df-4a61-b43f-394bcce90619 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:39.881857 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-dca44518-d1df-4a61-b43f-394bcce90619 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:39.882290 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-dca44518-d1df-4a61-b43f-394bcce90619 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:40.022905 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-dca44518-d1df-4a61-b43f-394bcce90619 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:40.031272 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-dca44518-d1df-4a61-b43f-394bcce90619 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:40.032768 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-dca44518-d1df-4a61-b43f-394bcce90619 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:12:40.033941 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-dca44518-d1df-4a61-b43f-394bcce90619 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1717 microversion: 2.20 time: 0.164302 May 04 19:12:40.035046 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 440/865] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:12:39 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1717 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:12:40.102699 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-6616e3aa-d3e9-474d-b65e-a5184a0897e2 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:40.103299 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-6616e3aa-d3e9-474d-b65e-a5184a0897e2 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: c0ca0b46-570c-45ff-820a-87a4197033f3] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:40.109529 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6616e3aa-d3e9-474d-b65e-a5184a0897e2 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:40.109977 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6616e3aa-d3e9-474d-b65e-a5184a0897e2 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:40.110732 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6616e3aa-d3e9-474d-b65e-a5184a0897e2 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:40.111165 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6616e3aa-d3e9-474d-b65e-a5184a0897e2 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:40.124147 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.wsgi [None req-6616e3aa-d3e9-474d-b65e-a5184a0897e2 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] HTTP exception thrown: Instance c0ca0b46-570c-45ff-820a-87a4197033f3 could not be found. May 04 19:12:40.124652 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-6616e3aa-d3e9-474d-b65e-a5184a0897e2 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Returning 404 to user: Instance c0ca0b46-570c-45ff-820a-87a4197033f3 could not be found. {{(pid=117125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 04 19:12:40.125552 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-6616e3aa-d3e9-474d-b65e-a5184a0897e2 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/c0ca0b46-570c-45ff-820a-87a4197033f3" status: 404 len: 111 microversion: 2.1 time: 0.026742 May 04 19:12:40.126092 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 426/866] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:12:40 2022] GET /compute/v2.1/servers/c0ca0b46-570c-45ff-820a-87a4197033f3 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 04 19:12:40.134941 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-ff97de69-57a2-4b4d-ae60-82ad2dbd3697 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '.version_select at 0x7fc3fb2885e0>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:40.152511 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-ff97de69-57a2-4b4d-ae60-82ad2dbd3697 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1700834279" status: 202 len: 0 microversion: 2.1 time: 0.021876 May 04 19:12:40.153069 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 441/867] 10.222.0.69 () {58 vars in 1220 bytes} [Wed May 4 19:12:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1700834279 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 04 19:12:42.986687 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-22a7d993-7471-4bc0-826c-5a71abc932ac tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:42.987438 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-22a7d993-7471-4bc0-826c-5a71abc932ac tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: c0ca0b46-570c-45ff-820a-87a4197033f3] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:42.994442 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-22a7d993-7471-4bc0-826c-5a71abc932ac tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:42.995006 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-22a7d993-7471-4bc0-826c-5a71abc932ac tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:42.995869 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-22a7d993-7471-4bc0-826c-5a71abc932ac tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:42.996408 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-22a7d993-7471-4bc0-826c-5a71abc932ac tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:43.011435 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.wsgi [None req-22a7d993-7471-4bc0-826c-5a71abc932ac tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] HTTP exception thrown: Instance c0ca0b46-570c-45ff-820a-87a4197033f3 could not be found. May 04 19:12:43.012326 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-22a7d993-7471-4bc0-826c-5a71abc932ac tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Returning 404 to user: Instance c0ca0b46-570c-45ff-820a-87a4197033f3 could not be found. {{(pid=117125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 04 19:12:43.013348 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-22a7d993-7471-4bc0-826c-5a71abc932ac tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "DELETE /compute/v2.1/servers/c0ca0b46-570c-45ff-820a-87a4197033f3" status: 404 len: 111 microversion: 2.1 time: 0.030497 May 04 19:12:43.014084 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 427/868] 10.222.0.69 () {58 vars in 1238 bytes} [Wed May 4 19:12:42 2022] DELETE /compute/v2.1/servers/c0ca0b46-570c-45ff-820a-87a4197033f3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 04 19:12:43.023059 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-2bd68766-682d-4912-99ac-57f45e700470 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:43.023671 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-2bd68766-682d-4912-99ac-57f45e700470 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: c0ca0b46-570c-45ff-820a-87a4197033f3] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:43.030257 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2bd68766-682d-4912-99ac-57f45e700470 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:43.030700 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2bd68766-682d-4912-99ac-57f45e700470 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:43.031456 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2bd68766-682d-4912-99ac-57f45e700470 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:43.031894 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2bd68766-682d-4912-99ac-57f45e700470 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:43.044974 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.wsgi [None req-2bd68766-682d-4912-99ac-57f45e700470 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] HTTP exception thrown: Instance c0ca0b46-570c-45ff-820a-87a4197033f3 could not be found. May 04 19:12:43.045587 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-2bd68766-682d-4912-99ac-57f45e700470 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Returning 404 to user: Instance c0ca0b46-570c-45ff-820a-87a4197033f3 could not be found. {{(pid=117124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 04 19:12:43.046403 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-2bd68766-682d-4912-99ac-57f45e700470 tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/c0ca0b46-570c-45ff-820a-87a4197033f3" status: 404 len: 111 microversion: 2.1 time: 0.027872 May 04 19:12:43.046933 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 442/869] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:12:43 2022] GET /compute/v2.1/servers/c0ca0b46-570c-45ff-820a-87a4197033f3 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 04 19:12:44.175525 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-b67b4488-5771-4219-a66f-02d0c17db7bc tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:44.176023 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-b67b4488-5771-4219-a66f-02d0c17db7bc tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:44.182296 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b67b4488-5771-4219-a66f-02d0c17db7bc tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:44.182746 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b67b4488-5771-4219-a66f-02d0c17db7bc tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:44.183507 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b67b4488-5771-4219-a66f-02d0c17db7bc tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:44.183945 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b67b4488-5771-4219-a66f-02d0c17db7bc tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:44.198255 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.wsgi [None req-b67b4488-5771-4219-a66f-02d0c17db7bc tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] HTTP exception thrown: Instance f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d could not be found. May 04 19:12:44.198827 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-b67b4488-5771-4219-a66f-02d0c17db7bc tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Returning 404 to user: Instance f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d could not be found. {{(pid=117125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 04 19:12:44.199631 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-b67b4488-5771-4219-a66f-02d0c17db7bc tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "DELETE /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 404 len: 111 microversion: 2.1 time: 0.028085 May 04 19:12:44.200141 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 428/870] 10.222.0.69 () {58 vars in 1238 bytes} [Wed May 4 19:12:44 2022] DELETE /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 04 19:12:44.207789 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-28e8c097-d19f-4fb6-a387-7ca4852d61ba tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:44.208399 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-28e8c097-d19f-4fb6-a387-7ca4852d61ba tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] [instance: f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:12:44.218582 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-28e8c097-d19f-4fb6-a387-7ca4852d61ba tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:44.219030 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-28e8c097-d19f-4fb6-a387-7ca4852d61ba tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:44.219928 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-28e8c097-d19f-4fb6-a387-7ca4852d61ba tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:12:44.220266 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-28e8c097-d19f-4fb6-a387-7ca4852d61ba tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:12:44.235691 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.wsgi [None req-28e8c097-d19f-4fb6-a387-7ca4852d61ba tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] HTTP exception thrown: Instance f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d could not be found. May 04 19:12:44.236203 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-28e8c097-d19f-4fb6-a387-7ca4852d61ba tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] Returning 404 to user: Instance f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d could not be found. {{(pid=117124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 04 19:12:44.237010 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-28e8c097-d19f-4fb6-a387-7ca4852d61ba tempest-AttachVolumeTestJSON-1255084976 tempest-AttachVolumeTestJSON-1255084976-project] 10.222.0.69 "GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d" status: 404 len: 111 microversion: 2.1 time: 0.033027 May 04 19:12:44.237560 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 443/871] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:12:44 2022] GET /compute/v2.1/servers/f6779b48-cc1c-4bd5-91a9-c8eba5f91c0d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 04 19:12:48.845528 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-0477cde5-482d-4c55-b84e-d7b0fc8e8971 tempest-VolumesSnapshotsTestJSON-241613274 tempest-VolumesSnapshotsTestJSON-241613274-project] Action: 'create', calling method: .version_select at 0x7fc3f604a3a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-16305747"}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:12:49.118864 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-0477cde5-482d-4c55-b84e-d7b0fc8e8971 tempest-VolumesSnapshotsTestJSON-241613274 tempest-VolumesSnapshotsTestJSON-241613274-project] 10.222.0.69 "POST /compute/v2.1/os-volumes" status: 200 len: 343 microversion: 2.1 time: 0.381470 May 04 19:12:49.119649 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 429/872] 10.222.0.69 () {60 vars in 1154 bytes} [Wed May 4 19:12:48 2022] POST /compute/v2.1/os-volumes => generated 343 bytes in 383 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 04 19:12:49.130284 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-9389e7dd-a879-447a-a568-9a69c65baba0 tempest-VolumesSnapshotsTestJSON-241613274 tempest-VolumesSnapshotsTestJSON-241613274-project] Calling method '.version_select at 0x7fc3fb27de50>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:49.178494 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-9389e7dd-a879-447a-a568-9a69c65baba0 tempest-VolumesSnapshotsTestJSON-241613274 tempest-VolumesSnapshotsTestJSON-241613274-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/7343647a-5818-404c-96e7-c995edc651c2" status: 200 len: 343 microversion: 2.1 time: 0.051983 May 04 19:12:49.179072 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 444/873] 10.222.0.69 () {58 vars in 1244 bytes} [Wed May 4 19:12:49 2022] GET /compute/v2.1/os-volumes/7343647a-5818-404c-96e7-c995edc651c2 => generated 343 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:12:50.192090 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-cc2c6a85-44a5-4e50-b0b3-3572c5e9832a tempest-VolumesSnapshotsTestJSON-241613274 tempest-VolumesSnapshotsTestJSON-241613274-project] Calling method '.version_select at 0x7fc3f60ba0d0>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:50.240134 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-cc2c6a85-44a5-4e50-b0b3-3572c5e9832a tempest-VolumesSnapshotsTestJSON-241613274 tempest-VolumesSnapshotsTestJSON-241613274-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/7343647a-5818-404c-96e7-c995edc651c2" status: 200 len: 343 microversion: 2.1 time: 0.052270 May 04 19:12:50.240700 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 430/874] 10.222.0.69 () {58 vars in 1244 bytes} [Wed May 4 19:12:50 2022] GET /compute/v2.1/os-volumes/7343647a-5818-404c-96e7-c995edc651c2 => generated 343 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:12:51.252902 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-19a6f453-7132-4259-bbcb-30632b0e00c2 tempest-VolumesSnapshotsTestJSON-241613274 tempest-VolumesSnapshotsTestJSON-241613274-project] Calling method '.version_select at 0x7fc3fb288ee0>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:51.300667 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-19a6f453-7132-4259-bbcb-30632b0e00c2 tempest-VolumesSnapshotsTestJSON-241613274 tempest-VolumesSnapshotsTestJSON-241613274-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/7343647a-5818-404c-96e7-c995edc651c2" status: 200 len: 343 microversion: 2.1 time: 0.052071 May 04 19:12:51.301263 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 445/875] 10.222.0.69 () {58 vars in 1244 bytes} [Wed May 4 19:12:51 2022] GET /compute/v2.1/os-volumes/7343647a-5818-404c-96e7-c995edc651c2 => generated 343 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 04 19:12:52.313453 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-1e8e8d26-9d19-4660-a3af-dee0ae491b86 tempest-VolumesSnapshotsTestJSON-241613274 tempest-VolumesSnapshotsTestJSON-241613274-project] Calling method '.version_select at 0x7fc3f6137f70>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:52.362532 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-1e8e8d26-9d19-4660-a3af-dee0ae491b86 tempest-VolumesSnapshotsTestJSON-241613274 tempest-VolumesSnapshotsTestJSON-241613274-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/7343647a-5818-404c-96e7-c995edc651c2" status: 200 len: 344 microversion: 2.1 time: 0.053202 May 04 19:12:52.363209 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 431/876] 10.222.0.69 () {58 vars in 1244 bytes} [Wed May 4 19:12:52 2022] GET /compute/v2.1/os-volumes/7343647a-5818-404c-96e7-c995edc651c2 => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:12:52.375283 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-53afecfe-97ee-4ecc-9f6b-1cf726371a02 tempest-VolumesSnapshotsTestJSON-241613274 tempest-VolumesSnapshotsTestJSON-241613274-project] Action: 'create', calling method: .version_select at 0x7fc3fb2d5310>, body: {"snapshot": {"volume_id": "7343647a-5818-404c-96e7-c995edc651c2", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1593506851"}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:12:52.536724 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-53afecfe-97ee-4ecc-9f6b-1cf726371a02 tempest-VolumesSnapshotsTestJSON-241613274 tempest-VolumesSnapshotsTestJSON-241613274-project] 10.222.0.69 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.165844 May 04 19:12:52.537416 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 446/877] 10.222.0.69 () {60 vars in 1161 bytes} [Wed May 4 19:12:52 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:12:52.549356 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-d83b9365-5659-4c1f-8553-2fb08c6f26ec tempest-VolumesSnapshotsTestJSON-241613274 tempest-VolumesSnapshotsTestJSON-241613274-project] Calling method '.version_select at 0x7fc3f6097c10>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:52.580316 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-d83b9365-5659-4c1f-8553-2fb08c6f26ec tempest-VolumesSnapshotsTestJSON-241613274 tempest-VolumesSnapshotsTestJSON-241613274-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/a1d0f539-cc3e-4539-ae55-ed1ce4db6e0d" status: 200 len: 287 microversion: 2.1 time: 0.036380 May 04 19:12:52.580906 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 432/878] 10.222.0.69 () {58 vars in 1250 bytes} [Wed May 4 19:12:52 2022] GET /compute/v2.1/os-snapshots/a1d0f539-cc3e-4539-ae55-ed1ce4db6e0d => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 04 19:12:52.591099 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-2ecb626a-9849-437c-9170-d6f6a376444a tempest-VolumesSnapshotsTestJSON-241613274 tempest-VolumesSnapshotsTestJSON-241613274-project] Calling method '.version_select at 0x7fc3fb2105e0>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:52.622907 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-2ecb626a-9849-437c-9170-d6f6a376444a tempest-VolumesSnapshotsTestJSON-241613274 tempest-VolumesSnapshotsTestJSON-241613274-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.036194 May 04 19:12:52.623501 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 447/879] 10.222.0.69 () {58 vars in 1139 bytes} [Wed May 4 19:12:52 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 04 19:12:52.633702 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-12606503-d1cd-4975-9466-4a3e681d741d tempest-VolumesSnapshotsTestJSON-241613274 tempest-VolumesSnapshotsTestJSON-241613274-project] Calling method '.version_select at 0x7fc3f60d1820>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:52.666791 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-12606503-d1cd-4975-9466-4a3e681d741d tempest-VolumesSnapshotsTestJSON-241613274 tempest-VolumesSnapshotsTestJSON-241613274-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/a1d0f539-cc3e-4539-ae55-ed1ce4db6e0d" status: 200 len: 287 microversion: 2.1 time: 0.036914 May 04 19:12:52.667363 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 433/880] 10.222.0.69 () {58 vars in 1250 bytes} [Wed May 4 19:12:52 2022] GET /compute/v2.1/os-snapshots/a1d0f539-cc3e-4539-ae55-ed1ce4db6e0d => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:12:53.678252 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-8abff2f8-8159-4832-9b89-d8c888ea29a6 tempest-VolumesSnapshotsTestJSON-241613274 tempest-VolumesSnapshotsTestJSON-241613274-project] Calling method '.version_select at 0x7fc3fb266ee0>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:53.708873 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-8abff2f8-8159-4832-9b89-d8c888ea29a6 tempest-VolumesSnapshotsTestJSON-241613274 tempest-VolumesSnapshotsTestJSON-241613274-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/a1d0f539-cc3e-4539-ae55-ed1ce4db6e0d" status: 200 len: 287 microversion: 2.1 time: 0.034788 May 04 19:12:53.709571 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 448/881] 10.222.0.69 () {58 vars in 1250 bytes} [Wed May 4 19:12:53 2022] GET /compute/v2.1/os-snapshots/a1d0f539-cc3e-4539-ae55-ed1ce4db6e0d => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:12:54.721050 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-911a3b4e-c918-4b60-898b-688ede7ef885 tempest-VolumesSnapshotsTestJSON-241613274 tempest-VolumesSnapshotsTestJSON-241613274-project] Calling method '.version_select at 0x7fc3f6097dc0>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:54.748924 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-911a3b4e-c918-4b60-898b-688ede7ef885 tempest-VolumesSnapshotsTestJSON-241613274 tempest-VolumesSnapshotsTestJSON-241613274-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/a1d0f539-cc3e-4539-ae55-ed1ce4db6e0d" status: 200 len: 287 microversion: 2.1 time: 0.032188 May 04 19:12:54.749523 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 434/882] 10.222.0.69 () {58 vars in 1250 bytes} [Wed May 4 19:12:54 2022] GET /compute/v2.1/os-snapshots/a1d0f539-cc3e-4539-ae55-ed1ce4db6e0d => generated 287 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:12:55.761481 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-8bffc542-fbd3-4b94-bf02-39bf682e8426 tempest-VolumesSnapshotsTestJSON-241613274 tempest-VolumesSnapshotsTestJSON-241613274-project] Calling method '.version_select at 0x7fc3fb25a550>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:55.791048 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-8bffc542-fbd3-4b94-bf02-39bf682e8426 tempest-VolumesSnapshotsTestJSON-241613274 tempest-VolumesSnapshotsTestJSON-241613274-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/a1d0f539-cc3e-4539-ae55-ed1ce4db6e0d" status: 200 len: 288 microversion: 2.1 time: 0.034609 May 04 19:12:55.791618 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 449/883] 10.222.0.69 () {58 vars in 1250 bytes} [Wed May 4 19:12:55 2022] GET /compute/v2.1/os-snapshots/a1d0f539-cc3e-4539-ae55-ed1ce4db6e0d => generated 288 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:12:55.802301 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-72a413bf-bc8a-43b1-9b53-51f8fd549550 tempest-VolumesSnapshotsTestJSON-241613274 tempest-VolumesSnapshotsTestJSON-241613274-project] Calling method '.version_select at 0x7fc3f60faa60>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:55.856747 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-72a413bf-bc8a-43b1-9b53-51f8fd549550 tempest-VolumesSnapshotsTestJSON-241613274 tempest-VolumesSnapshotsTestJSON-241613274-project] 10.222.0.69 "DELETE /compute/v2.1/os-snapshots/a1d0f539-cc3e-4539-ae55-ed1ce4db6e0d" status: 202 len: 0 microversion: 2.1 time: 0.058705 May 04 19:12:55.857310 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 435/884] 10.222.0.69 () {58 vars in 1253 bytes} [Wed May 4 19:12:55 2022] DELETE /compute/v2.1/os-snapshots/a1d0f539-cc3e-4539-ae55-ed1ce4db6e0d => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 04 19:12:55.865506 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-ee1531bf-0bc2-4ce7-ad03-f5ccaa433256 tempest-VolumesSnapshotsTestJSON-241613274 tempest-VolumesSnapshotsTestJSON-241613274-project] Calling method '.version_select at 0x7fc3fb288430>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:55.893624 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-ee1531bf-0bc2-4ce7-ad03-f5ccaa433256 tempest-VolumesSnapshotsTestJSON-241613274 tempest-VolumesSnapshotsTestJSON-241613274-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/a1d0f539-cc3e-4539-ae55-ed1ce4db6e0d" status: 200 len: 287 microversion: 2.1 time: 0.031847 May 04 19:12:55.894172 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 450/885] 10.222.0.69 () {58 vars in 1250 bytes} [Wed May 4 19:12:55 2022] GET /compute/v2.1/os-snapshots/a1d0f539-cc3e-4539-ae55-ed1ce4db6e0d => generated 287 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:12:56.906219 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-72914d04-2d8c-4bb2-bcdf-f15418fda929 tempest-VolumesSnapshotsTestJSON-241613274 tempest-VolumesSnapshotsTestJSON-241613274-project] Calling method '.version_select at 0x7fc3f6117b80>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:56.930512 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.wsgi [None req-72914d04-2d8c-4bb2-bcdf-f15418fda929 tempest-VolumesSnapshotsTestJSON-241613274 tempest-VolumesSnapshotsTestJSON-241613274-project] HTTP exception thrown: Snapshot a1d0f539-cc3e-4539-ae55-ed1ce4db6e0d could not be found. May 04 19:12:56.931173 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-72914d04-2d8c-4bb2-bcdf-f15418fda929 tempest-VolumesSnapshotsTestJSON-241613274 tempest-VolumesSnapshotsTestJSON-241613274-project] Returning 404 to user: Snapshot a1d0f539-cc3e-4539-ae55-ed1ce4db6e0d could not be found. {{(pid=117125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 04 19:12:56.931996 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-72914d04-2d8c-4bb2-bcdf-f15418fda929 tempest-VolumesSnapshotsTestJSON-241613274 tempest-VolumesSnapshotsTestJSON-241613274-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/a1d0f539-cc3e-4539-ae55-ed1ce4db6e0d" status: 404 len: 111 microversion: 2.1 time: 0.030143 May 04 19:12:56.932525 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 436/886] 10.222.0.69 () {58 vars in 1250 bytes} [Wed May 4 19:12:56 2022] GET /compute/v2.1/os-snapshots/a1d0f539-cc3e-4539-ae55-ed1ce4db6e0d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 04 19:12:56.940956 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-b9fa17d3-0275-4f4c-bdf4-cbd20d1362a2 tempest-VolumesSnapshotsTestJSON-241613274 tempest-VolumesSnapshotsTestJSON-241613274-project] Calling method '.version_select at 0x7fc3fb27d310>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:57.001215 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-b9fa17d3-0275-4f4c-bdf4-cbd20d1362a2 tempest-VolumesSnapshotsTestJSON-241613274 tempest-VolumesSnapshotsTestJSON-241613274-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/7343647a-5818-404c-96e7-c995edc651c2" status: 202 len: 0 microversion: 2.1 time: 0.064341 May 04 19:12:57.001961 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 451/887] 10.222.0.69 () {58 vars in 1247 bytes} [Wed May 4 19:12:56 2022] DELETE /compute/v2.1/os-volumes/7343647a-5818-404c-96e7-c995edc651c2 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 04 19:12:57.009994 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-9382fae2-ab81-4388-8927-f04430381d48 tempest-VolumesSnapshotsTestJSON-241613274 tempest-VolumesSnapshotsTestJSON-241613274-project] Calling method '.version_select at 0x7fc3f60faa60>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:57.056989 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-9382fae2-ab81-4388-8927-f04430381d48 tempest-VolumesSnapshotsTestJSON-241613274 tempest-VolumesSnapshotsTestJSON-241613274-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/7343647a-5818-404c-96e7-c995edc651c2" status: 200 len: 343 microversion: 2.1 time: 0.050693 May 04 19:12:57.057605 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 437/888] 10.222.0.69 () {58 vars in 1244 bytes} [Wed May 4 19:12:57 2022] GET /compute/v2.1/os-volumes/7343647a-5818-404c-96e7-c995edc651c2 => generated 343 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:12:58.070047 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-c2384854-ee7e-4f91-9f6e-5ab16d96be24 tempest-VolumesSnapshotsTestJSON-241613274 tempest-VolumesSnapshotsTestJSON-241613274-project] Calling method '.version_select at 0x7fc3f618f940>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:58.096138 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.wsgi [None req-c2384854-ee7e-4f91-9f6e-5ab16d96be24 tempest-VolumesSnapshotsTestJSON-241613274 tempest-VolumesSnapshotsTestJSON-241613274-project] HTTP exception thrown: Volume 7343647a-5818-404c-96e7-c995edc651c2 could not be found. May 04 19:12:58.096724 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-c2384854-ee7e-4f91-9f6e-5ab16d96be24 tempest-VolumesSnapshotsTestJSON-241613274 tempest-VolumesSnapshotsTestJSON-241613274-project] Returning 404 to user: Volume 7343647a-5818-404c-96e7-c995edc651c2 could not be found. {{(pid=117124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 04 19:12:58.097573 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-c2384854-ee7e-4f91-9f6e-5ab16d96be24 tempest-VolumesSnapshotsTestJSON-241613274 tempest-VolumesSnapshotsTestJSON-241613274-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/7343647a-5818-404c-96e7-c995edc651c2" status: 404 len: 109 microversion: 2.1 time: 0.031911 May 04 19:12:58.098095 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 452/889] 10.222.0.69 () {58 vars in 1244 bytes} [Wed May 4 19:12:58 2022] GET /compute/v2.1/os-volumes/7343647a-5818-404c-96e7-c995edc651c2 => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 04 19:12:58.112362 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-198ba673-1a8c-4b41-87da-fd040f67790b tempest-VolumesSnapshotsTestJSON-241613274 tempest-VolumesSnapshotsTestJSON-241613274-project] Calling method '.version_select at 0x7fc3f6097dc0>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:58.139438 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.wsgi [None req-198ba673-1a8c-4b41-87da-fd040f67790b tempest-VolumesSnapshotsTestJSON-241613274 tempest-VolumesSnapshotsTestJSON-241613274-project] HTTP exception thrown: Volume 7343647a-5818-404c-96e7-c995edc651c2 could not be found. May 04 19:12:58.140033 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-198ba673-1a8c-4b41-87da-fd040f67790b tempest-VolumesSnapshotsTestJSON-241613274 tempest-VolumesSnapshotsTestJSON-241613274-project] Returning 404 to user: Volume 7343647a-5818-404c-96e7-c995edc651c2 could not be found. {{(pid=117125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 04 19:12:58.140847 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-198ba673-1a8c-4b41-87da-fd040f67790b tempest-VolumesSnapshotsTestJSON-241613274 tempest-VolumesSnapshotsTestJSON-241613274-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/7343647a-5818-404c-96e7-c995edc651c2" status: 404 len: 109 microversion: 2.1 time: 0.032768 May 04 19:12:58.141665 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 438/890] 10.222.0.69 () {58 vars in 1247 bytes} [Wed May 4 19:12:58 2022] DELETE /compute/v2.1/os-volumes/7343647a-5818-404c-96e7-c995edc651c2 => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 04 19:12:58.149379 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-14589824-99ac-471f-a981-def85ea6e638 tempest-VolumesSnapshotsTestJSON-241613274 tempest-VolumesSnapshotsTestJSON-241613274-project] Calling method '.version_select at 0x7fc3fb27d430>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:12:58.175024 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.wsgi [None req-14589824-99ac-471f-a981-def85ea6e638 tempest-VolumesSnapshotsTestJSON-241613274 tempest-VolumesSnapshotsTestJSON-241613274-project] HTTP exception thrown: Volume 7343647a-5818-404c-96e7-c995edc651c2 could not be found. May 04 19:12:58.175599 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-14589824-99ac-471f-a981-def85ea6e638 tempest-VolumesSnapshotsTestJSON-241613274 tempest-VolumesSnapshotsTestJSON-241613274-project] Returning 404 to user: Volume 7343647a-5818-404c-96e7-c995edc651c2 could not be found. {{(pid=117124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 04 19:12:58.176433 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-14589824-99ac-471f-a981-def85ea6e638 tempest-VolumesSnapshotsTestJSON-241613274 tempest-VolumesSnapshotsTestJSON-241613274-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/7343647a-5818-404c-96e7-c995edc651c2" status: 404 len: 109 microversion: 2.1 time: 0.030844 May 04 19:12:58.176946 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 453/891] 10.222.0.69 () {58 vars in 1244 bytes} [Wed May 4 19:12:58 2022] GET /compute/v2.1/os-volumes/7343647a-5818-404c-96e7-c995edc651c2 => generated 109 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 04 19:13:07.103076 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-5f85661d-1a5d-468c-97ba-7e60edc128d5 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:13:07.103611 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-5f85661d-1a5d-468c-97ba-7e60edc128d5 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 2af1ff2e-191e-467e-b95d-1bc5f35d7e15] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:13:07.109401 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5f85661d-1a5d-468c-97ba-7e60edc128d5 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:07.109880 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5f85661d-1a5d-468c-97ba-7e60edc128d5 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:07.110637 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5f85661d-1a5d-468c-97ba-7e60edc128d5 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:07.111073 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5f85661d-1a5d-468c-97ba-7e60edc128d5 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:07.134189 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-5f85661d-1a5d-468c-97ba-7e60edc128d5 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/2af1ff2e-191e-467e-b95d-1bc5f35d7e15/ips" status: 200 len: 151 microversion: 2.1 time: 0.208097 May 04 19:13:07.134732 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 439/892] 10.222.0.69 () {58 vars in 1247 bytes} [Wed May 4 19:13:06 2022] GET /compute/v2.1/servers/2af1ff2e-191e-467e-b95d-1bc5f35d7e15/ips => generated 151 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:13:10.542790 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-cab7aea9-78c1-42ba-b5b2-f8d77fc7c9ad tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c1592330-ac50-4fa5-8c9b-f5881d87d10f"}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:13:10.543889 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-cab7aea9-78c1-42ba-b5b2-f8d77fc7c9ad tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 2af1ff2e-191e-467e-b95d-1bc5f35d7e15] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:13:10.550403 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-cab7aea9-78c1-42ba-b5b2-f8d77fc7c9ad tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:10.550874 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-cab7aea9-78c1-42ba-b5b2-f8d77fc7c9ad tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:10.551669 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-cab7aea9-78c1-42ba-b5b2-f8d77fc7c9ad tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:10.552112 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-cab7aea9-78c1-42ba-b5b2-f8d77fc7c9ad tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:10.836861 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-cab7aea9-78c1-42ba-b5b2-f8d77fc7c9ad tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "POST /compute/v2.1/servers/2af1ff2e-191e-467e-b95d-1bc5f35d7e15/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.299180 May 04 19:13:10.837483 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 454/893] 10.222.0.69 () {60 vars in 1322 bytes} [Wed May 4 19:13:10 2022] POST /compute/v2.1/servers/2af1ff2e-191e-467e-b95d-1bc5f35d7e15/os-volume_attachments => generated 194 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:13:18.574744 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-34febce5-7b5a-4a63-98bb-4723cec0f172 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:13:18.575501 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-34febce5-7b5a-4a63-98bb-4723cec0f172 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 2af1ff2e-191e-467e-b95d-1bc5f35d7e15] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:13:18.581749 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-34febce5-7b5a-4a63-98bb-4723cec0f172 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:18.582165 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-34febce5-7b5a-4a63-98bb-4723cec0f172 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:18.582916 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-34febce5-7b5a-4a63-98bb-4723cec0f172 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:18.583352 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-34febce5-7b5a-4a63-98bb-4723cec0f172 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:18.661847 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.objects.instance [None req-34febce5-7b5a-4a63-98bb-4723cec0f172 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lazy-loading 'services' on Instance uuid 2af1ff2e-191e-467e-b95d-1bc5f35d7e15 {{(pid=117125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 04 19:13:18.731576 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-34febce5-7b5a-4a63-98bb-4723cec0f172 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "DELETE /compute/v2.1/servers/2af1ff2e-191e-467e-b95d-1bc5f35d7e15/os-volume_attachments/c1592330-ac50-4fa5-8c9b-f5881d87d10f" status: 202 len: 0 microversion: 2.1 time: 0.160756 May 04 19:13:18.732439 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 440/894] 10.222.0.69 () {58 vars in 1415 bytes} [Wed May 4 19:13:18 2022] DELETE /compute/v2.1/servers/2af1ff2e-191e-467e-b95d-1bc5f35d7e15/os-volume_attachments/c1592330-ac50-4fa5-8c9b-f5881d87d10f => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 04 19:13:18.741889 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-941b9bcc-c7de-44ef-a171-7af20b817909 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:13:18.743511 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-941b9bcc-c7de-44ef-a171-7af20b817909 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 2af1ff2e-191e-467e-b95d-1bc5f35d7e15] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:13:18.750498 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-941b9bcc-c7de-44ef-a171-7af20b817909 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:18.751024 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-941b9bcc-c7de-44ef-a171-7af20b817909 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:18.751722 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-941b9bcc-c7de-44ef-a171-7af20b817909 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:18.752499 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-941b9bcc-c7de-44ef-a171-7af20b817909 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:18.788596 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-941b9bcc-c7de-44ef-a171-7af20b817909 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/2af1ff2e-191e-467e-b95d-1bc5f35d7e15/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051398 May 04 19:13:18.789385 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 455/895] 10.222.0.69 () {58 vars in 1301 bytes} [Wed May 4 19:13:18 2022] GET /compute/v2.1/servers/2af1ff2e-191e-467e-b95d-1bc5f35d7e15/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:13:19.808935 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-dd84ff2e-8b6c-4af5-b697-5543ffaec93b tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:13:19.808935 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-dd84ff2e-8b6c-4af5-b697-5543ffaec93b tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 2af1ff2e-191e-467e-b95d-1bc5f35d7e15] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:13:19.810746 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-dd84ff2e-8b6c-4af5-b697-5543ffaec93b tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:19.811283 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-dd84ff2e-8b6c-4af5-b697-5543ffaec93b tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:19.812249 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-dd84ff2e-8b6c-4af5-b697-5543ffaec93b tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:19.812723 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-dd84ff2e-8b6c-4af5-b697-5543ffaec93b tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:19.848097 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-dd84ff2e-8b6c-4af5-b697-5543ffaec93b tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/2af1ff2e-191e-467e-b95d-1bc5f35d7e15/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047326 May 04 19:13:19.848097 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 441/896] 10.222.0.69 () {58 vars in 1301 bytes} [Wed May 4 19:13:19 2022] GET /compute/v2.1/servers/2af1ff2e-191e-467e-b95d-1bc5f35d7e15/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:13:20.855626 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-91e1cb78-3484-44e3-aaec-9a452f540bcd tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:13:20.856580 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-91e1cb78-3484-44e3-aaec-9a452f540bcd tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 2af1ff2e-191e-467e-b95d-1bc5f35d7e15] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:13:20.862915 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-91e1cb78-3484-44e3-aaec-9a452f540bcd tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:20.863368 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-91e1cb78-3484-44e3-aaec-9a452f540bcd tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:20.864156 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-91e1cb78-3484-44e3-aaec-9a452f540bcd tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:20.864596 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-91e1cb78-3484-44e3-aaec-9a452f540bcd tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:20.892347 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-91e1cb78-3484-44e3-aaec-9a452f540bcd tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/2af1ff2e-191e-467e-b95d-1bc5f35d7e15/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041434 May 04 19:13:20.892889 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 456/897] 10.222.0.69 () {58 vars in 1301 bytes} [Wed May 4 19:13:20 2022] GET /compute/v2.1/servers/2af1ff2e-191e-467e-b95d-1bc5f35d7e15/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:13:21.904436 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-8b9fdde0-c618-4cfd-a270-cbaed26b0691 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:13:21.905559 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-8b9fdde0-c618-4cfd-a270-cbaed26b0691 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 2af1ff2e-191e-467e-b95d-1bc5f35d7e15] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:13:21.912506 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8b9fdde0-c618-4cfd-a270-cbaed26b0691 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:21.912955 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8b9fdde0-c618-4cfd-a270-cbaed26b0691 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:21.913752 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8b9fdde0-c618-4cfd-a270-cbaed26b0691 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:21.914188 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8b9fdde0-c618-4cfd-a270-cbaed26b0691 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:21.941422 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-8b9fdde0-c618-4cfd-a270-cbaed26b0691 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/2af1ff2e-191e-467e-b95d-1bc5f35d7e15/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041671 May 04 19:13:21.942005 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 442/898] 10.222.0.69 () {58 vars in 1301 bytes} [Wed May 4 19:13:21 2022] GET /compute/v2.1/servers/2af1ff2e-191e-467e-b95d-1bc5f35d7e15/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 04 19:13:22.001824 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-b92352d8-aec7-4ec5-9bc1-e7c824c19300 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:13:22.002351 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-b92352d8-aec7-4ec5-9bc1-e7c824c19300 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 2af1ff2e-191e-467e-b95d-1bc5f35d7e15] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:13:22.008600 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b92352d8-aec7-4ec5-9bc1-e7c824c19300 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:22.009042 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b92352d8-aec7-4ec5-9bc1-e7c824c19300 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:22.010307 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b92352d8-aec7-4ec5-9bc1-e7c824c19300 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:22.010739 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b92352d8-aec7-4ec5-9bc1-e7c824c19300 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:22.035460 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-b92352d8-aec7-4ec5-9bc1-e7c824c19300 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 2af1ff2e-191e-467e-b95d-1bc5f35d7e15] Going to try to terminate instance {{(pid=117124) delete /opt/stack/nova/nova/compute/api.py:2664}} May 04 19:13:22.106499 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-b92352d8-aec7-4ec5-9bc1-e7c824c19300 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "DELETE /compute/v2.1/servers/2af1ff2e-191e-467e-b95d-1bc5f35d7e15" status: 204 len: 0 microversion: 2.1 time: 0.108184 May 04 19:13:22.107096 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 457/899] 10.222.0.69 () {58 vars in 1238 bytes} [Wed May 4 19:13:21 2022] DELETE /compute/v2.1/servers/2af1ff2e-191e-467e-b95d-1bc5f35d7e15 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 04 19:13:22.117045 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-ba031798-9fee-44d9-a4e3-9d3979a1d7d4 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:13:22.117721 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-ba031798-9fee-44d9-a4e3-9d3979a1d7d4 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 2af1ff2e-191e-467e-b95d-1bc5f35d7e15] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:13:22.123699 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ba031798-9fee-44d9-a4e3-9d3979a1d7d4 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:22.124154 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ba031798-9fee-44d9-a4e3-9d3979a1d7d4 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:22.124919 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ba031798-9fee-44d9-a4e3-9d3979a1d7d4 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:22.125363 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ba031798-9fee-44d9-a4e3-9d3979a1d7d4 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:22.251096 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-ba031798-9fee-44d9-a4e3-9d3979a1d7d4 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:13:22.258361 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-ba031798-9fee-44d9-a4e3-9d3979a1d7d4 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/2af1ff2e-191e-467e-b95d-1bc5f35d7e15" status: 200 len: 1680 microversion: 2.1 time: 0.146737 May 04 19:13:22.258943 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 443/900] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:13:22 2022] GET /compute/v2.1/servers/2af1ff2e-191e-467e-b95d-1bc5f35d7e15 => generated 1680 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:13:22.334889 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-24fdfbe1-00c3-46b3-a9fa-3bb135b54624 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:13:22.335905 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-24fdfbe1-00c3-46b3-a9fa-3bb135b54624 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:13:22.341828 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-24fdfbe1-00c3-46b3-a9fa-3bb135b54624 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:22.342283 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-24fdfbe1-00c3-46b3-a9fa-3bb135b54624 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:22.343050 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-24fdfbe1-00c3-46b3-a9fa-3bb135b54624 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:22.343489 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-24fdfbe1-00c3-46b3-a9fa-3bb135b54624 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:22.372841 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-24fdfbe1-00c3-46b3-a9fa-3bb135b54624 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042318 May 04 19:13:22.373387 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 458/901] 10.222.0.69 () {60 vars in 1342 bytes} [Wed May 4 19:13:22 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:13:22.434185 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-c24c45b9-49af-43d3-896d-6deead6813af tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:13:22.434767 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-c24c45b9-49af-43d3-896d-6deead6813af tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:13:22.440680 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c24c45b9-49af-43d3-896d-6deead6813af tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:22.441209 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c24c45b9-49af-43d3-896d-6deead6813af tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:22.442057 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c24c45b9-49af-43d3-896d-6deead6813af tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:22.442556 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c24c45b9-49af-43d3-896d-6deead6813af tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:22.472151 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-c24c45b9-49af-43d3-896d-6deead6813af tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Going to try to terminate instance {{(pid=117125) delete /opt/stack/nova/nova/compute/api.py:2664}} May 04 19:13:22.550051 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-c24c45b9-49af-43d3-896d-6deead6813af tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "DELETE /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 204 len: 0 microversion: 2.20 time: 0.119928 May 04 19:13:22.550621 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 444/902] 10.222.0.69 () {60 vars in 1279 bytes} [Wed May 4 19:13:22 2022] DELETE /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 04 19:13:22.559317 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-f7d5a13c-381a-42d1-b928-3d588d3e3de6 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:13:22.559918 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-f7d5a13c-381a-42d1-b928-3d588d3e3de6 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:13:22.566302 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f7d5a13c-381a-42d1-b928-3d588d3e3de6 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:22.566758 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f7d5a13c-381a-42d1-b928-3d588d3e3de6 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:22.567563 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f7d5a13c-381a-42d1-b928-3d588d3e3de6 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:22.568129 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f7d5a13c-381a-42d1-b928-3d588d3e3de6 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:22.707319 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-f7d5a13c-381a-42d1-b928-3d588d3e3de6 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:13:22.715189 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-f7d5a13c-381a-42d1-b928-3d588d3e3de6 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:13:22.716661 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-f7d5a13c-381a-42d1-b928-3d588d3e3de6 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:13:22.717961 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-f7d5a13c-381a-42d1-b928-3d588d3e3de6 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1723 microversion: 2.20 time: 0.162827 May 04 19:13:22.718514 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 459/903] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:13:22 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 04 19:13:23.277202 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-0de562e1-16ae-44d8-8cf9-16b5be68cf26 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:13:23.277851 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-0de562e1-16ae-44d8-8cf9-16b5be68cf26 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 2af1ff2e-191e-467e-b95d-1bc5f35d7e15] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:13:23.284091 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0de562e1-16ae-44d8-8cf9-16b5be68cf26 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:23.284528 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0de562e1-16ae-44d8-8cf9-16b5be68cf26 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:23.285273 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0de562e1-16ae-44d8-8cf9-16b5be68cf26 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:23.285734 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0de562e1-16ae-44d8-8cf9-16b5be68cf26 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:23.413512 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-0de562e1-16ae-44d8-8cf9-16b5be68cf26 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:13:23.420957 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-0de562e1-16ae-44d8-8cf9-16b5be68cf26 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/2af1ff2e-191e-467e-b95d-1bc5f35d7e15" status: 200 len: 1680 microversion: 2.1 time: 0.148564 May 04 19:13:23.422345 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 445/904] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:13:23 2022] GET /compute/v2.1/servers/2af1ff2e-191e-467e-b95d-1bc5f35d7e15 => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:13:23.735668 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-cb6428e3-99c0-4e52-9138-1cdc0bb31051 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:13:23.736276 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-cb6428e3-99c0-4e52-9138-1cdc0bb31051 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:13:23.742582 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-cb6428e3-99c0-4e52-9138-1cdc0bb31051 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:23.743028 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-cb6428e3-99c0-4e52-9138-1cdc0bb31051 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:23.743785 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-cb6428e3-99c0-4e52-9138-1cdc0bb31051 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:23.744219 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-cb6428e3-99c0-4e52-9138-1cdc0bb31051 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:23.873637 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-cb6428e3-99c0-4e52-9138-1cdc0bb31051 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:13:23.881272 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-cb6428e3-99c0-4e52-9138-1cdc0bb31051 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:13:23.882860 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-cb6428e3-99c0-4e52-9138-1cdc0bb31051 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:13:23.883952 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-cb6428e3-99c0-4e52-9138-1cdc0bb31051 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1723 microversion: 2.20 time: 0.152093 May 04 19:13:23.884514 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 460/905] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:13:23 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:13:24.438266 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-3790df5b-ac19-4449-b6da-97ecb0833e4c tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:13:24.438865 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-3790df5b-ac19-4449-b6da-97ecb0833e4c tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 2af1ff2e-191e-467e-b95d-1bc5f35d7e15] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:13:24.445176 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3790df5b-ac19-4449-b6da-97ecb0833e4c tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:24.445658 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3790df5b-ac19-4449-b6da-97ecb0833e4c tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:24.446420 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3790df5b-ac19-4449-b6da-97ecb0833e4c tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:24.447352 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3790df5b-ac19-4449-b6da-97ecb0833e4c tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:24.570172 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-3790df5b-ac19-4449-b6da-97ecb0833e4c tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:13:24.578140 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-3790df5b-ac19-4449-b6da-97ecb0833e4c tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/2af1ff2e-191e-467e-b95d-1bc5f35d7e15" status: 200 len: 1680 microversion: 2.1 time: 0.143718 May 04 19:13:24.578702 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 446/906] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:13:24 2022] GET /compute/v2.1/servers/2af1ff2e-191e-467e-b95d-1bc5f35d7e15 => generated 1680 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:13:24.902478 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-8b52470a-bd96-46a2-b314-0533cbc830f7 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:13:24.903090 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-8b52470a-bd96-46a2-b314-0533cbc830f7 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:13:24.909394 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8b52470a-bd96-46a2-b314-0533cbc830f7 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:24.909884 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8b52470a-bd96-46a2-b314-0533cbc830f7 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:24.910651 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8b52470a-bd96-46a2-b314-0533cbc830f7 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:24.911088 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8b52470a-bd96-46a2-b314-0533cbc830f7 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:25.042897 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-8b52470a-bd96-46a2-b314-0533cbc830f7 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:13:25.050830 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-8b52470a-bd96-46a2-b314-0533cbc830f7 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:13:25.052324 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-8b52470a-bd96-46a2-b314-0533cbc830f7 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:13:25.053539 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-8b52470a-bd96-46a2-b314-0533cbc830f7 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1723 microversion: 2.20 time: 0.154969 May 04 19:13:25.054097 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 461/907] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:13:24 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:13:25.595158 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-a9836806-6b0b-4fbb-b4c7-279565c96778 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:13:25.595788 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-a9836806-6b0b-4fbb-b4c7-279565c96778 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 2af1ff2e-191e-467e-b95d-1bc5f35d7e15] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:13:25.602106 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a9836806-6b0b-4fbb-b4c7-279565c96778 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:25.602552 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a9836806-6b0b-4fbb-b4c7-279565c96778 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:25.603913 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a9836806-6b0b-4fbb-b4c7-279565c96778 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:25.604347 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a9836806-6b0b-4fbb-b4c7-279565c96778 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:25.737762 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-a9836806-6b0b-4fbb-b4c7-279565c96778 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:13:25.745036 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-a9836806-6b0b-4fbb-b4c7-279565c96778 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/2af1ff2e-191e-467e-b95d-1bc5f35d7e15" status: 200 len: 1680 microversion: 2.1 time: 0.153733 May 04 19:13:25.745626 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 447/908] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:13:25 2022] GET /compute/v2.1/servers/2af1ff2e-191e-467e-b95d-1bc5f35d7e15 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:13:26.072502 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-4fe6c4c3-3b4b-4546-a434-94f33bd6a348 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:13:26.073115 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-4fe6c4c3-3b4b-4546-a434-94f33bd6a348 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:13:26.079317 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4fe6c4c3-3b4b-4546-a434-94f33bd6a348 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:26.079758 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4fe6c4c3-3b4b-4546-a434-94f33bd6a348 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:26.080512 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4fe6c4c3-3b4b-4546-a434-94f33bd6a348 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:26.080944 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4fe6c4c3-3b4b-4546-a434-94f33bd6a348 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:26.209119 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-4fe6c4c3-3b4b-4546-a434-94f33bd6a348 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:13:26.217093 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-4fe6c4c3-3b4b-4546-a434-94f33bd6a348 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:13:26.218625 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-4fe6c4c3-3b4b-4546-a434-94f33bd6a348 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:13:26.219777 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-4fe6c4c3-3b4b-4546-a434-94f33bd6a348 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1723 microversion: 2.20 time: 0.151692 May 04 19:13:26.220364 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 462/909] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:13:26 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:13:26.761332 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-e1694ed1-0d81-4e68-8afb-6dda749613d1 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:13:26.762064 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-e1694ed1-0d81-4e68-8afb-6dda749613d1 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 2af1ff2e-191e-467e-b95d-1bc5f35d7e15] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:13:26.768827 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e1694ed1-0d81-4e68-8afb-6dda749613d1 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:26.769451 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e1694ed1-0d81-4e68-8afb-6dda749613d1 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:26.770430 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e1694ed1-0d81-4e68-8afb-6dda749613d1 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:26.770895 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e1694ed1-0d81-4e68-8afb-6dda749613d1 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:26.905478 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-e1694ed1-0d81-4e68-8afb-6dda749613d1 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:13:26.912684 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-e1694ed1-0d81-4e68-8afb-6dda749613d1 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/2af1ff2e-191e-467e-b95d-1bc5f35d7e15" status: 200 len: 1680 microversion: 2.1 time: 0.155181 May 04 19:13:26.913243 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 448/910] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:13:26 2022] GET /compute/v2.1/servers/2af1ff2e-191e-467e-b95d-1bc5f35d7e15 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:13:27.238059 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-18ba384c-93f2-44e6-a82e-35ea6e3682f7 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:13:27.238673 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-18ba384c-93f2-44e6-a82e-35ea6e3682f7 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:13:27.244748 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-18ba384c-93f2-44e6-a82e-35ea6e3682f7 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:27.245198 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-18ba384c-93f2-44e6-a82e-35ea6e3682f7 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:27.245983 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-18ba384c-93f2-44e6-a82e-35ea6e3682f7 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:27.246417 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-18ba384c-93f2-44e6-a82e-35ea6e3682f7 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:27.373849 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-18ba384c-93f2-44e6-a82e-35ea6e3682f7 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:13:27.381490 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-18ba384c-93f2-44e6-a82e-35ea6e3682f7 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:13:27.382997 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-18ba384c-93f2-44e6-a82e-35ea6e3682f7 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:13:27.384149 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-18ba384c-93f2-44e6-a82e-35ea6e3682f7 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1723 microversion: 2.20 time: 0.150288 May 04 19:13:27.384710 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 463/911] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:13:27 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:13:27.930135 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-dce2ac0e-dd37-4853-932f-15346d6bd2d8 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:13:27.930741 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-dce2ac0e-dd37-4853-932f-15346d6bd2d8 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 2af1ff2e-191e-467e-b95d-1bc5f35d7e15] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:13:27.937865 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-dce2ac0e-dd37-4853-932f-15346d6bd2d8 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:27.938388 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-dce2ac0e-dd37-4853-932f-15346d6bd2d8 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:27.939319 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-dce2ac0e-dd37-4853-932f-15346d6bd2d8 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:27.939758 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-dce2ac0e-dd37-4853-932f-15346d6bd2d8 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:28.078313 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-dce2ac0e-dd37-4853-932f-15346d6bd2d8 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:13:28.085938 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-dce2ac0e-dd37-4853-932f-15346d6bd2d8 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/2af1ff2e-191e-467e-b95d-1bc5f35d7e15" status: 200 len: 1680 microversion: 2.1 time: 0.159799 May 04 19:13:28.086506 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 449/912] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:13:27 2022] GET /compute/v2.1/servers/2af1ff2e-191e-467e-b95d-1bc5f35d7e15 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:13:28.403641 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-41ce67a2-2deb-4eaf-8875-15195c7064e0 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:13:28.404182 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-41ce67a2-2deb-4eaf-8875-15195c7064e0 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:13:28.410432 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-41ce67a2-2deb-4eaf-8875-15195c7064e0 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:28.410879 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-41ce67a2-2deb-4eaf-8875-15195c7064e0 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:28.411646 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-41ce67a2-2deb-4eaf-8875-15195c7064e0 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:28.412267 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-41ce67a2-2deb-4eaf-8875-15195c7064e0 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:28.981551 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-41ce67a2-2deb-4eaf-8875-15195c7064e0 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:13:28.990595 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-41ce67a2-2deb-4eaf-8875-15195c7064e0 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:13:28.992108 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-41ce67a2-2deb-4eaf-8875-15195c7064e0 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:13:28.993318 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-41ce67a2-2deb-4eaf-8875-15195c7064e0 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1723 microversion: 2.20 time: 0.594145 May 04 19:13:28.993912 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 464/913] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:13:28 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1723 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:13:29.104334 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-19ef6717-d108-49cc-90ac-9dabfce6ec7b tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:13:29.105794 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-19ef6717-d108-49cc-90ac-9dabfce6ec7b tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 2af1ff2e-191e-467e-b95d-1bc5f35d7e15] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:13:29.112412 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-19ef6717-d108-49cc-90ac-9dabfce6ec7b tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:29.112861 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-19ef6717-d108-49cc-90ac-9dabfce6ec7b tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:29.113727 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-19ef6717-d108-49cc-90ac-9dabfce6ec7b tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:29.114930 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-19ef6717-d108-49cc-90ac-9dabfce6ec7b tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:29.393166 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-0d972b9f-a2c6-4070-a3b9-1c3f54bdc479 req-e02c18e7-c2fb-4956-b297-7937f248d2d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2af1ff2e-191e-467e-b95d-1bc5f35d7e15", "name": "network-vif-deleted", "tag": "7f533959-c4f2-4e4f-a8ac-4b978c96fb26"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:13:29.423961 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-0d972b9f-a2c6-4070-a3b9-1c3f54bdc479 req-e02c18e7-c2fb-4956-b297-7937f248d2d0 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:29.425557 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-0d972b9f-a2c6-4070-a3b9-1c3f54bdc479 req-e02c18e7-c2fb-4956-b297-7937f248d2d0 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:29.462455 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-19ef6717-d108-49cc-90ac-9dabfce6ec7b tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98211cfafca84542a64f8b3f0b34303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1ba9318cf84308a3ff6ce6da85755d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:13:29.471055 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-19ef6717-d108-49cc-90ac-9dabfce6ec7b tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/2af1ff2e-191e-467e-b95d-1bc5f35d7e15" status: 200 len: 1614 microversion: 2.1 time: 0.371046 May 04 19:13:29.473387 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 450/914] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:13:29 2022] GET /compute/v2.1/servers/2af1ff2e-191e-467e-b95d-1bc5f35d7e15 => generated 1614 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:13:29.674827 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-0d972b9f-a2c6-4070-a3b9-1c3f54bdc479 req-e02c18e7-c2fb-4956-b297-7937f248d2d0 service nova] Creating event network-vif-deleted:7f533959-c4f2-4e4f-a8ac-4b978c96fb26 for instance 2af1ff2e-191e-467e-b95d-1bc5f35d7e15 on hv-cinder-83090 May 04 19:13:29.680401 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-0d972b9f-a2c6-4070-a3b9-1c3f54bdc479 req-e02c18e7-c2fb-4956-b297-7937f248d2d0 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.291132 May 04 19:13:29.686168 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 465/915] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:13:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 04 19:13:30.012388 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-afac8a7e-b77c-43e3-8048-8d63c6085747 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:13:30.013003 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-afac8a7e-b77c-43e3-8048-8d63c6085747 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:13:30.020460 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-afac8a7e-b77c-43e3-8048-8d63c6085747 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:30.020921 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-afac8a7e-b77c-43e3-8048-8d63c6085747 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:30.022001 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-afac8a7e-b77c-43e3-8048-8d63c6085747 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:30.022445 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-afac8a7e-b77c-43e3-8048-8d63c6085747 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:30.054658 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-afac8a7e-b77c-43e3-8048-8d63c6085747 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:30.055112 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-afac8a7e-b77c-43e3-8048-8d63c6085747 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:30.055567 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.objects.instance [None req-afac8a7e-b77c-43e3-8048-8d63c6085747 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lazy-loading 'fault' on Instance uuid bc9f6260-f308-4f45-809e-40f50eeb47d6 {{(pid=117125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 04 19:13:30.095902 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-afac8a7e-b77c-43e3-8048-8d63c6085747 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:13:30.104182 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-afac8a7e-b77c-43e3-8048-8d63c6085747 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:13:30.105789 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-afac8a7e-b77c-43e3-8048-8d63c6085747 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '047fb46d1a764838bd8f8a44609a2e6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7beef313fe3439db0866cfdb10fdbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:13:30.106937 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-afac8a7e-b77c-43e3-8048-8d63c6085747 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 200 len: 1371 microversion: 2.20 time: 0.098650 May 04 19:13:30.107698 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 451/916] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:13:30 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 1371 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 04 19:13:30.489802 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-9c61cd86-1fbe-40aa-8d6d-260a6792065c tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:13:30.490809 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-9c61cd86-1fbe-40aa-8d6d-260a6792065c tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 2af1ff2e-191e-467e-b95d-1bc5f35d7e15] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:13:30.502408 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9c61cd86-1fbe-40aa-8d6d-260a6792065c tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:30.503400 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9c61cd86-1fbe-40aa-8d6d-260a6792065c tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:30.504769 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9c61cd86-1fbe-40aa-8d6d-260a6792065c tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:30.505217 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9c61cd86-1fbe-40aa-8d6d-260a6792065c tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:30.520607 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.wsgi [None req-9c61cd86-1fbe-40aa-8d6d-260a6792065c tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] HTTP exception thrown: Instance 2af1ff2e-191e-467e-b95d-1bc5f35d7e15 could not be found. May 04 19:13:30.521215 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-9c61cd86-1fbe-40aa-8d6d-260a6792065c tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Returning 404 to user: Instance 2af1ff2e-191e-467e-b95d-1bc5f35d7e15 could not be found. {{(pid=117124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 04 19:13:30.522084 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-9c61cd86-1fbe-40aa-8d6d-260a6792065c tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/2af1ff2e-191e-467e-b95d-1bc5f35d7e15" status: 404 len: 111 microversion: 2.1 time: 0.037462 May 04 19:13:30.522629 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 466/917] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:13:30 2022] GET /compute/v2.1/servers/2af1ff2e-191e-467e-b95d-1bc5f35d7e15 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 04 19:13:30.531619 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-28457f83-d739-4aa1-acc7-742dd2ad006a tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '.version_select at 0x7fc3f606a160>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:13:30.550223 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-28457f83-d739-4aa1-acc7-742dd2ad006a tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-420589444" status: 202 len: 0 microversion: 2.1 time: 0.022323 May 04 19:13:30.550960 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 452/918] 10.222.0.69 () {58 vars in 1217 bytes} [Wed May 4 19:13:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-420589444 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 04 19:13:31.126224 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-4984208b-0495-41ec-ba47-b6ec49739760 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:13:31.127208 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-4984208b-0495-41ec-ba47-b6ec49739760 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:13:31.133500 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4984208b-0495-41ec-ba47-b6ec49739760 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:31.134256 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4984208b-0495-41ec-ba47-b6ec49739760 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:31.135814 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4984208b-0495-41ec-ba47-b6ec49739760 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:31.136765 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4984208b-0495-41ec-ba47-b6ec49739760 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:31.152065 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.wsgi [None req-4984208b-0495-41ec-ba47-b6ec49739760 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] HTTP exception thrown: Instance bc9f6260-f308-4f45-809e-40f50eeb47d6 could not be found. May 04 19:13:31.152905 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-4984208b-0495-41ec-ba47-b6ec49739760 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Returning 404 to user: Instance bc9f6260-f308-4f45-809e-40f50eeb47d6 could not be found. {{(pid=117124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 04 19:13:31.154312 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-4984208b-0495-41ec-ba47-b6ec49739760 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 404 len: 111 microversion: 2.20 time: 0.032487 May 04 19:13:31.155531 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 467/919] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:13:31 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 04 19:13:31.164112 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-09a6dd06-dbb6-4679-a9f6-ce6ee7efee92 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '.version_select at 0x7fc3f60b0ca0>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:13:31.189542 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-09a6dd06-dbb6-4679-a9f6-ce6ee7efee92 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1378786842" status: 204 len: 0 microversion: 2.20 time: 0.029271 May 04 19:13:31.190774 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 453/920] 10.222.0.69 () {60 vars in 1261 bytes} [Wed May 4 19:13:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1378786842 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 04 19:13:31.696804 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-b0630c35-491f-4e07-a785-e46f0dbb47aa req-a19477e2-eeb9-471e-8c41-36fb857a3257 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc9f6260-f308-4f45-809e-40f50eeb47d6", "name": "network-vif-deleted", "tag": "7d596d4a-07a6-43a1-bc43-abfd6db7c370"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:13:31.706097 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-b0630c35-491f-4e07-a785-e46f0dbb47aa req-a19477e2-eeb9-471e-8c41-36fb857a3257 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:31.706541 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-b0630c35-491f-4e07-a785-e46f0dbb47aa req-a19477e2-eeb9-471e-8c41-36fb857a3257 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:31.719529 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-b0630c35-491f-4e07-a785-e46f0dbb47aa req-a19477e2-eeb9-471e-8c41-36fb857a3257 service nova] Creating event network-vif-deleted:7d596d4a-07a6-43a1-bc43-abfd6db7c370 for instance bc9f6260-f308-4f45-809e-40f50eeb47d6 on hv-cinder-83090 May 04 19:13:31.724906 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-b0630c35-491f-4e07-a785-e46f0dbb47aa req-a19477e2-eeb9-471e-8c41-36fb857a3257 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031668 May 04 19:13:31.725753 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 468/921] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:13:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:13:32.494179 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-3e48b97c-3e57-4989-a810-bdab316af840 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:13:32.494179 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-3e48b97c-3e57-4989-a810-bdab316af840 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 2af1ff2e-191e-467e-b95d-1bc5f35d7e15] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:13:32.512024 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3e48b97c-3e57-4989-a810-bdab316af840 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:32.512024 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3e48b97c-3e57-4989-a810-bdab316af840 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:32.512024 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3e48b97c-3e57-4989-a810-bdab316af840 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:32.512024 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3e48b97c-3e57-4989-a810-bdab316af840 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:32.519819 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.wsgi [None req-3e48b97c-3e57-4989-a810-bdab316af840 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] HTTP exception thrown: Instance 2af1ff2e-191e-467e-b95d-1bc5f35d7e15 could not be found. May 04 19:13:32.520620 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-3e48b97c-3e57-4989-a810-bdab316af840 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Returning 404 to user: Instance 2af1ff2e-191e-467e-b95d-1bc5f35d7e15 could not be found. {{(pid=117125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 04 19:13:32.521741 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-3e48b97c-3e57-4989-a810-bdab316af840 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "DELETE /compute/v2.1/servers/2af1ff2e-191e-467e-b95d-1bc5f35d7e15" status: 404 len: 111 microversion: 2.1 time: 0.032412 May 04 19:13:32.534437 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-dc48a44a-cb4c-48d2-8bfe-836733003524 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:13:32.535162 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-dc48a44a-cb4c-48d2-8bfe-836733003524 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 2af1ff2e-191e-467e-b95d-1bc5f35d7e15] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:13:32.537773 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 454/922] 10.222.0.69 () {58 vars in 1238 bytes} [Wed May 4 19:13:32 2022] DELETE /compute/v2.1/servers/2af1ff2e-191e-467e-b95d-1bc5f35d7e15 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 04 19:13:32.541954 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-dc48a44a-cb4c-48d2-8bfe-836733003524 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:32.542418 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-dc48a44a-cb4c-48d2-8bfe-836733003524 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:32.543330 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-dc48a44a-cb4c-48d2-8bfe-836733003524 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:32.543825 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-dc48a44a-cb4c-48d2-8bfe-836733003524 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:32.557980 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.wsgi [None req-dc48a44a-cb4c-48d2-8bfe-836733003524 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] HTTP exception thrown: Instance 2af1ff2e-191e-467e-b95d-1bc5f35d7e15 could not be found. May 04 19:13:32.558874 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-dc48a44a-cb4c-48d2-8bfe-836733003524 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Returning 404 to user: Instance 2af1ff2e-191e-467e-b95d-1bc5f35d7e15 could not be found. {{(pid=117124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 04 19:13:32.559809 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-dc48a44a-cb4c-48d2-8bfe-836733003524 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/2af1ff2e-191e-467e-b95d-1bc5f35d7e15" status: 404 len: 111 microversion: 2.1 time: 0.032411 May 04 19:13:32.560434 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 469/923] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:13:32 2022] GET /compute/v2.1/servers/2af1ff2e-191e-467e-b95d-1bc5f35d7e15 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 04 19:13:33.069778 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-473b1059-9d46-48d9-87d7-0f9b34d1c4e2 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:13:33.070337 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-473b1059-9d46-48d9-87d7-0f9b34d1c4e2 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:13:33.077453 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-473b1059-9d46-48d9-87d7-0f9b34d1c4e2 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:33.077981 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-473b1059-9d46-48d9-87d7-0f9b34d1c4e2 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:33.078767 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-473b1059-9d46-48d9-87d7-0f9b34d1c4e2 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:33.079209 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-473b1059-9d46-48d9-87d7-0f9b34d1c4e2 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:33.093525 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.wsgi [None req-473b1059-9d46-48d9-87d7-0f9b34d1c4e2 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] HTTP exception thrown: Instance bc9f6260-f308-4f45-809e-40f50eeb47d6 could not be found. May 04 19:13:33.094122 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-473b1059-9d46-48d9-87d7-0f9b34d1c4e2 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Returning 404 to user: Instance bc9f6260-f308-4f45-809e-40f50eeb47d6 could not be found. {{(pid=117125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 04 19:13:33.094953 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-473b1059-9d46-48d9-87d7-0f9b34d1c4e2 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "DELETE /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 404 len: 111 microversion: 2.20 time: 0.029094 May 04 19:13:33.095526 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 455/924] 10.222.0.69 () {60 vars in 1279 bytes} [Wed May 4 19:13:33 2022] DELETE /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 04 19:13:33.103385 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-fdf52322-3967-469f-ae09-32d1a8ca2171 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:13:33.104086 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-fdf52322-3967-469f-ae09-32d1a8ca2171 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: bc9f6260-f308-4f45-809e-40f50eeb47d6] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:13:33.110518 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fdf52322-3967-469f-ae09-32d1a8ca2171 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:33.111067 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fdf52322-3967-469f-ae09-32d1a8ca2171 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:33.111902 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fdf52322-3967-469f-ae09-32d1a8ca2171 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:33.112416 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fdf52322-3967-469f-ae09-32d1a8ca2171 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:33.126327 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.wsgi [None req-fdf52322-3967-469f-ae09-32d1a8ca2171 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] HTTP exception thrown: Instance bc9f6260-f308-4f45-809e-40f50eeb47d6 could not be found. May 04 19:13:33.126989 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-fdf52322-3967-469f-ae09-32d1a8ca2171 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Returning 404 to user: Instance bc9f6260-f308-4f45-809e-40f50eeb47d6 could not be found. {{(pid=117124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 04 19:13:33.127875 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-fdf52322-3967-469f-ae09-32d1a8ca2171 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6" status: 404 len: 111 microversion: 2.20 time: 0.028387 May 04 19:13:33.128444 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 470/925] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:13:33 2022] GET /compute/v2.1/servers/bc9f6260-f308-4f45-809e-40f50eeb47d6 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 04 19:13:33.705080 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-2d76e173-47a4-4796-8698-28f6d43efe07 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:13:33.705745 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-2d76e173-47a4-4796-8698-28f6d43efe07 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 81874ac9-ec8c-4fb1-bd75-762920f7042d] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:13:33.712264 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2d76e173-47a4-4796-8698-28f6d43efe07 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:33.712809 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2d76e173-47a4-4796-8698-28f6d43efe07 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:33.713606 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2d76e173-47a4-4796-8698-28f6d43efe07 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:33.714039 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2d76e173-47a4-4796-8698-28f6d43efe07 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:33.730346 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.wsgi [None req-2d76e173-47a4-4796-8698-28f6d43efe07 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] HTTP exception thrown: Instance 81874ac9-ec8c-4fb1-bd75-762920f7042d could not be found. May 04 19:13:33.731581 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-2d76e173-47a4-4796-8698-28f6d43efe07 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Returning 404 to user: Instance 81874ac9-ec8c-4fb1-bd75-762920f7042d could not be found. {{(pid=117125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 04 19:13:33.732408 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-2d76e173-47a4-4796-8698-28f6d43efe07 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "DELETE /compute/v2.1/servers/81874ac9-ec8c-4fb1-bd75-762920f7042d" status: 404 len: 111 microversion: 2.1 time: 0.031740 May 04 19:13:33.733340 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 456/926] 10.222.0.69 () {58 vars in 1238 bytes} [Wed May 4 19:13:33 2022] DELETE /compute/v2.1/servers/81874ac9-ec8c-4fb1-bd75-762920f7042d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 04 19:13:33.741220 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-4affafaa-56b0-4ed9-b002-75c071282434 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:13:33.742505 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-4affafaa-56b0-4ed9-b002-75c071282434 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 81874ac9-ec8c-4fb1-bd75-762920f7042d] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:13:33.749064 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4affafaa-56b0-4ed9-b002-75c071282434 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:33.749629 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4affafaa-56b0-4ed9-b002-75c071282434 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:33.750462 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4affafaa-56b0-4ed9-b002-75c071282434 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:33.751148 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4affafaa-56b0-4ed9-b002-75c071282434 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:33.765247 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.wsgi [None req-4affafaa-56b0-4ed9-b002-75c071282434 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] HTTP exception thrown: Instance 81874ac9-ec8c-4fb1-bd75-762920f7042d could not be found. May 04 19:13:33.765867 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-4affafaa-56b0-4ed9-b002-75c071282434 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Returning 404 to user: Instance 81874ac9-ec8c-4fb1-bd75-762920f7042d could not be found. {{(pid=117124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 04 19:13:33.766926 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-4affafaa-56b0-4ed9-b002-75c071282434 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/81874ac9-ec8c-4fb1-bd75-762920f7042d" status: 404 len: 111 microversion: 2.1 time: 0.029583 May 04 19:13:33.767626 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 471/927] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:13:33 2022] GET /compute/v2.1/servers/81874ac9-ec8c-4fb1-bd75-762920f7042d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 04 19:13:33.775803 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-70af112a-b76a-4a6c-9336-2322dee72bf0 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:13:33.776314 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-70af112a-b76a-4a6c-9336-2322dee72bf0 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 50e3af6c-83e8-4320-8157-06ed4ef20cda] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:13:33.782318 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-70af112a-b76a-4a6c-9336-2322dee72bf0 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:33.782790 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-70af112a-b76a-4a6c-9336-2322dee72bf0 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:33.783641 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-70af112a-b76a-4a6c-9336-2322dee72bf0 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:33.784085 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-70af112a-b76a-4a6c-9336-2322dee72bf0 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:33.798891 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.wsgi [None req-70af112a-b76a-4a6c-9336-2322dee72bf0 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] HTTP exception thrown: Instance 50e3af6c-83e8-4320-8157-06ed4ef20cda could not be found. May 04 19:13:33.799488 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-70af112a-b76a-4a6c-9336-2322dee72bf0 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Returning 404 to user: Instance 50e3af6c-83e8-4320-8157-06ed4ef20cda could not be found. {{(pid=117125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 04 19:13:33.800484 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-70af112a-b76a-4a6c-9336-2322dee72bf0 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "DELETE /compute/v2.1/servers/50e3af6c-83e8-4320-8157-06ed4ef20cda" status: 404 len: 111 microversion: 2.1 time: 0.028703 May 04 19:13:33.809556 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 457/928] 10.222.0.69 () {58 vars in 1238 bytes} [Wed May 4 19:13:33 2022] DELETE /compute/v2.1/servers/50e3af6c-83e8-4320-8157-06ed4ef20cda => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 04 19:13:33.809704 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-ec5a8ea8-99c4-4d14-ac99-8471361bcef6 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:13:33.810251 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-ec5a8ea8-99c4-4d14-ac99-8471361bcef6 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: 50e3af6c-83e8-4320-8157-06ed4ef20cda] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:13:33.816800 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ec5a8ea8-99c4-4d14-ac99-8471361bcef6 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:33.817455 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ec5a8ea8-99c4-4d14-ac99-8471361bcef6 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:33.818257 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ec5a8ea8-99c4-4d14-ac99-8471361bcef6 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:33.818694 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-ec5a8ea8-99c4-4d14-ac99-8471361bcef6 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:33.834613 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.wsgi [None req-ec5a8ea8-99c4-4d14-ac99-8471361bcef6 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] HTTP exception thrown: Instance 50e3af6c-83e8-4320-8157-06ed4ef20cda could not be found. May 04 19:13:33.835208 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-ec5a8ea8-99c4-4d14-ac99-8471361bcef6 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Returning 404 to user: Instance 50e3af6c-83e8-4320-8157-06ed4ef20cda could not be found. {{(pid=117124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 04 19:13:33.836315 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-ec5a8ea8-99c4-4d14-ac99-8471361bcef6 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/50e3af6c-83e8-4320-8157-06ed4ef20cda" status: 404 len: 111 microversion: 2.1 time: 0.031130 May 04 19:13:33.836864 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 472/929] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:13:33 2022] GET /compute/v2.1/servers/50e3af6c-83e8-4320-8157-06ed4ef20cda => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 04 19:13:34.259072 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-59bc120b-e2c6-441c-bb2a-7d0a0135d162 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:13:34.259649 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-59bc120b-e2c6-441c-bb2a-7d0a0135d162 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:13:34.265439 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-59bc120b-e2c6-441c-bb2a-7d0a0135d162 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:34.266343 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-59bc120b-e2c6-441c-bb2a-7d0a0135d162 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:34.266960 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-59bc120b-e2c6-441c-bb2a-7d0a0135d162 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:34.267424 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-59bc120b-e2c6-441c-bb2a-7d0a0135d162 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:34.282009 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.wsgi [None req-59bc120b-e2c6-441c-bb2a-7d0a0135d162 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] HTTP exception thrown: Instance 8f929e9e-51bf-477a-877b-6c162202c7f5 could not be found. May 04 19:13:34.282599 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-59bc120b-e2c6-441c-bb2a-7d0a0135d162 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Returning 404 to user: Instance 8f929e9e-51bf-477a-877b-6c162202c7f5 could not be found. {{(pid=117125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 04 19:13:34.283454 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-59bc120b-e2c6-441c-bb2a-7d0a0135d162 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "DELETE /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 404 len: 111 microversion: 2.20 time: 0.028290 May 04 19:13:34.283961 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 458/930] 10.222.0.69 () {60 vars in 1279 bytes} [Wed May 4 19:13:34 2022] DELETE /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 04 19:13:34.292825 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-584ac310-5cfc-40df-a25e-1759efe11d82 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:13:34.293444 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-584ac310-5cfc-40df-a25e-1759efe11d82 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] [instance: 8f929e9e-51bf-477a-877b-6c162202c7f5] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:13:34.299952 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-584ac310-5cfc-40df-a25e-1759efe11d82 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:34.300400 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-584ac310-5cfc-40df-a25e-1759efe11d82 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:34.301164 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-584ac310-5cfc-40df-a25e-1759efe11d82 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:34.301627 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-584ac310-5cfc-40df-a25e-1759efe11d82 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:34.315157 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.wsgi [None req-584ac310-5cfc-40df-a25e-1759efe11d82 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] HTTP exception thrown: Instance 8f929e9e-51bf-477a-877b-6c162202c7f5 could not be found. May 04 19:13:34.315743 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-584ac310-5cfc-40df-a25e-1759efe11d82 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] Returning 404 to user: Instance 8f929e9e-51bf-477a-877b-6c162202c7f5 could not be found. {{(pid=117124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 04 19:13:34.316583 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-584ac310-5cfc-40df-a25e-1759efe11d82 tempest-AttachVolumeShelveTestJSON-416088131 tempest-AttachVolumeShelveTestJSON-416088131-project] 10.222.0.69 "GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5" status: 404 len: 111 microversion: 2.20 time: 0.028467 May 04 19:13:34.317107 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 473/931] 10.222.0.69 () {60 vars in 1276 bytes} [Wed May 4 19:13:34 2022] GET /compute/v2.1/servers/8f929e9e-51bf-477a-877b-6c162202c7f5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 04 19:13:35.003889 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-52908140-fbd6-4d06-9863-2d2d89fb3ada tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:13:35.004948 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-52908140-fbd6-4d06-9863-2d2d89fb3ada tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: fae4a97e-a910-4f71-abf2-8f62425c6a52] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:13:35.011929 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-52908140-fbd6-4d06-9863-2d2d89fb3ada tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:35.012554 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-52908140-fbd6-4d06-9863-2d2d89fb3ada tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:35.013531 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-52908140-fbd6-4d06-9863-2d2d89fb3ada tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:35.014116 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-52908140-fbd6-4d06-9863-2d2d89fb3ada tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:35.028887 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.wsgi [None req-52908140-fbd6-4d06-9863-2d2d89fb3ada tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] HTTP exception thrown: Instance fae4a97e-a910-4f71-abf2-8f62425c6a52 could not be found. May 04 19:13:35.029824 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-52908140-fbd6-4d06-9863-2d2d89fb3ada tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Returning 404 to user: Instance fae4a97e-a910-4f71-abf2-8f62425c6a52 could not be found. {{(pid=117125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 04 19:13:35.030478 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-52908140-fbd6-4d06-9863-2d2d89fb3ada tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "DELETE /compute/v2.1/servers/fae4a97e-a910-4f71-abf2-8f62425c6a52" status: 404 len: 111 microversion: 2.1 time: 0.030462 May 04 19:13:35.031229 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 459/932] 10.222.0.69 () {58 vars in 1238 bytes} [Wed May 4 19:13:34 2022] DELETE /compute/v2.1/servers/fae4a97e-a910-4f71-abf2-8f62425c6a52 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 04 19:13:35.039763 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-1cefc10c-7aac-4d09-84d5-364af4e096b9 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:13:35.040378 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-1cefc10c-7aac-4d09-84d5-364af4e096b9 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] [instance: fae4a97e-a910-4f71-abf2-8f62425c6a52] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:13:35.046397 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1cefc10c-7aac-4d09-84d5-364af4e096b9 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:35.046848 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1cefc10c-7aac-4d09-84d5-364af4e096b9 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:35.047627 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1cefc10c-7aac-4d09-84d5-364af4e096b9 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:35.048246 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1cefc10c-7aac-4d09-84d5-364af4e096b9 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:35.062765 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.wsgi [None req-1cefc10c-7aac-4d09-84d5-364af4e096b9 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] HTTP exception thrown: Instance fae4a97e-a910-4f71-abf2-8f62425c6a52 could not be found. May 04 19:13:35.063293 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-1cefc10c-7aac-4d09-84d5-364af4e096b9 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] Returning 404 to user: Instance fae4a97e-a910-4f71-abf2-8f62425c6a52 could not be found. {{(pid=117124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 04 19:13:35.064413 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-1cefc10c-7aac-4d09-84d5-364af4e096b9 tempest-AttachVolumeNegativeTest-1230587408 tempest-AttachVolumeNegativeTest-1230587408-project] 10.222.0.69 "GET /compute/v2.1/servers/fae4a97e-a910-4f71-abf2-8f62425c6a52" status: 404 len: 111 microversion: 2.1 time: 0.028781 May 04 19:13:35.068267 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 474/933] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:13:35 2022] GET /compute/v2.1/servers/fae4a97e-a910-4f71-abf2-8f62425c6a52 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 04 19:13:39.850691 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-f77d7cb1-101f-4481-8920-020fae5d60c0 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:13:39.851299 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-f77d7cb1-101f-4481-8920-020fae5d60c0 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: a8c67aa1-879c-4bd2-a133-3d8319f9494a] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:13:39.860073 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f77d7cb1-101f-4481-8920-020fae5d60c0 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:39.861614 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f77d7cb1-101f-4481-8920-020fae5d60c0 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:39.862976 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f77d7cb1-101f-4481-8920-020fae5d60c0 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:39.878853 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f77d7cb1-101f-4481-8920-020fae5d60c0 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:39.927972 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-f77d7cb1-101f-4481-8920-020fae5d60c0 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: a8c67aa1-879c-4bd2-a133-3d8319f9494a] Going to try to terminate instance {{(pid=117125) delete /opt/stack/nova/nova/compute/api.py:2664}} May 04 19:13:40.027262 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-f77d7cb1-101f-4481-8920-020fae5d60c0 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "DELETE /compute/v2.1/servers/a8c67aa1-879c-4bd2-a133-3d8319f9494a" status: 204 len: 0 microversion: 2.1 time: 0.181179 May 04 19:13:40.028084 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 460/934] 10.222.0.69 () {58 vars in 1238 bytes} [Wed May 4 19:13:39 2022] DELETE /compute/v2.1/servers/a8c67aa1-879c-4bd2-a133-3d8319f9494a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 04 19:13:40.037874 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-c1473dd7-5061-4c66-8e57-3455c66ff8f0 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:13:40.039237 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-c1473dd7-5061-4c66-8e57-3455c66ff8f0 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: a8c67aa1-879c-4bd2-a133-3d8319f9494a] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:13:40.046554 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c1473dd7-5061-4c66-8e57-3455c66ff8f0 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:40.047086 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c1473dd7-5061-4c66-8e57-3455c66ff8f0 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:40.047922 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c1473dd7-5061-4c66-8e57-3455c66ff8f0 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:40.048428 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c1473dd7-5061-4c66-8e57-3455c66ff8f0 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:40.184167 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-c1473dd7-5061-4c66-8e57-3455c66ff8f0 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8b295066bc4ae695f6e60b9b3dc5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157e9c40125e42b4b5a908fc58bfa939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:13:40.200273 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-c1473dd7-5061-4c66-8e57-3455c66ff8f0 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "GET /compute/v2.1/servers/a8c67aa1-879c-4bd2-a133-3d8319f9494a" status: 200 len: 1577 microversion: 2.1 time: 0.167668 May 04 19:13:40.205566 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 475/935] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:13:40 2022] GET /compute/v2.1/servers/a8c67aa1-879c-4bd2-a133-3d8319f9494a => generated 1577 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:13:41.220454 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-384b4de3-e08d-4c87-8747-afc681a54032 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:13:41.221176 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-384b4de3-e08d-4c87-8747-afc681a54032 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: a8c67aa1-879c-4bd2-a133-3d8319f9494a] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:13:41.228179 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-384b4de3-e08d-4c87-8747-afc681a54032 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:41.228517 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-384b4de3-e08d-4c87-8747-afc681a54032 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:41.229294 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-384b4de3-e08d-4c87-8747-afc681a54032 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:41.229760 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-384b4de3-e08d-4c87-8747-afc681a54032 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:41.371548 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-384b4de3-e08d-4c87-8747-afc681a54032 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8b295066bc4ae695f6e60b9b3dc5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157e9c40125e42b4b5a908fc58bfa939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:13:41.379725 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-384b4de3-e08d-4c87-8747-afc681a54032 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "GET /compute/v2.1/servers/a8c67aa1-879c-4bd2-a133-3d8319f9494a" status: 200 len: 1577 microversion: 2.1 time: 0.163421 May 04 19:13:41.380281 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 461/936] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:13:41 2022] GET /compute/v2.1/servers/a8c67aa1-879c-4bd2-a133-3d8319f9494a => generated 1577 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:13:42.400876 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-bbe7567d-52e4-4332-8a3f-c400861d06c8 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:13:42.401519 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-bbe7567d-52e4-4332-8a3f-c400861d06c8 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: a8c67aa1-879c-4bd2-a133-3d8319f9494a] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:13:42.422184 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-bbe7567d-52e4-4332-8a3f-c400861d06c8 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:42.422864 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-bbe7567d-52e4-4332-8a3f-c400861d06c8 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:42.424359 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-bbe7567d-52e4-4332-8a3f-c400861d06c8 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:42.424967 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-bbe7567d-52e4-4332-8a3f-c400861d06c8 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:42.545752 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-bbe7567d-52e4-4332-8a3f-c400861d06c8 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8b295066bc4ae695f6e60b9b3dc5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157e9c40125e42b4b5a908fc58bfa939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:13:42.553156 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-bbe7567d-52e4-4332-8a3f-c400861d06c8 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "GET /compute/v2.1/servers/a8c67aa1-879c-4bd2-a133-3d8319f9494a" status: 200 len: 1510 microversion: 2.1 time: 0.159442 May 04 19:13:42.564637 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 476/937] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:13:42 2022] GET /compute/v2.1/servers/a8c67aa1-879c-4bd2-a133-3d8319f9494a => generated 1510 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:13:42.827176 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-07b54b27-8ed9-4c53-bac1-5717117b9dd3 req-b14b0d8d-966b-45a8-98b8-43df6a115160 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8c67aa1-879c-4bd2-a133-3d8319f9494a", "name": "network-vif-deleted", "tag": "60e7c55c-cf55-478e-8c07-010e76efb433"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:13:42.861971 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-07b54b27-8ed9-4c53-bac1-5717117b9dd3 req-b14b0d8d-966b-45a8-98b8-43df6a115160 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:42.863625 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-07b54b27-8ed9-4c53-bac1-5717117b9dd3 req-b14b0d8d-966b-45a8-98b8-43df6a115160 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:42.923944 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-07b54b27-8ed9-4c53-bac1-5717117b9dd3 req-b14b0d8d-966b-45a8-98b8-43df6a115160 service nova] Creating event network-vif-deleted:60e7c55c-cf55-478e-8c07-010e76efb433 for instance a8c67aa1-879c-4bd2-a133-3d8319f9494a on hv-cinder-83090 May 04 19:13:42.939065 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-07b54b27-8ed9-4c53-bac1-5717117b9dd3 req-b14b0d8d-966b-45a8-98b8-43df6a115160 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118630 May 04 19:13:42.941003 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 462/938] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:13:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:13:43.573935 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-c4cc229e-4560-46ab-804c-29451c111af2 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:13:43.579327 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-c4cc229e-4560-46ab-804c-29451c111af2 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: a8c67aa1-879c-4bd2-a133-3d8319f9494a] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:13:43.601843 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c4cc229e-4560-46ab-804c-29451c111af2 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:43.602317 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c4cc229e-4560-46ab-804c-29451c111af2 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:43.603921 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c4cc229e-4560-46ab-804c-29451c111af2 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:43.604363 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c4cc229e-4560-46ab-804c-29451c111af2 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:43.699508 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c4cc229e-4560-46ab-804c-29451c111af2 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:43.699508 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c4cc229e-4560-46ab-804c-29451c111af2 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:43.699508 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.objects.instance [None req-c4cc229e-4560-46ab-804c-29451c111af2 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lazy-loading 'fault' on Instance uuid a8c67aa1-879c-4bd2-a133-3d8319f9494a {{(pid=117124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 04 19:13:43.821528 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-c4cc229e-4560-46ab-804c-29451c111af2 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8b295066bc4ae695f6e60b9b3dc5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157e9c40125e42b4b5a908fc58bfa939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:13:43.832949 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-c4cc229e-4560-46ab-804c-29451c111af2 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "GET /compute/v2.1/servers/a8c67aa1-879c-4bd2-a133-3d8319f9494a" status: 200 len: 1230 microversion: 2.1 time: 0.262292 May 04 19:13:43.834201 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 477/939] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:13:43 2022] GET /compute/v2.1/servers/a8c67aa1-879c-4bd2-a133-3d8319f9494a => generated 1230 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:13:44.851585 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-3fa23ca0-a5d4-408a-bcff-7931856fab7f tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:13:44.852478 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-3fa23ca0-a5d4-408a-bcff-7931856fab7f tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: a8c67aa1-879c-4bd2-a133-3d8319f9494a] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:13:44.861550 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3fa23ca0-a5d4-408a-bcff-7931856fab7f tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:44.862262 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3fa23ca0-a5d4-408a-bcff-7931856fab7f tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:44.864250 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3fa23ca0-a5d4-408a-bcff-7931856fab7f tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:44.865285 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3fa23ca0-a5d4-408a-bcff-7931856fab7f tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:44.881812 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.wsgi [None req-3fa23ca0-a5d4-408a-bcff-7931856fab7f tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] HTTP exception thrown: Instance a8c67aa1-879c-4bd2-a133-3d8319f9494a could not be found. May 04 19:13:44.894212 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-3fa23ca0-a5d4-408a-bcff-7931856fab7f tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Returning 404 to user: Instance a8c67aa1-879c-4bd2-a133-3d8319f9494a could not be found. {{(pid=117125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 04 19:13:44.898074 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-3fa23ca0-a5d4-408a-bcff-7931856fab7f tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "GET /compute/v2.1/servers/a8c67aa1-879c-4bd2-a133-3d8319f9494a" status: 404 len: 111 microversion: 2.1 time: 0.049022 May 04 19:13:44.898660 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 463/940] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:13:44 2022] GET /compute/v2.1/servers/a8c67aa1-879c-4bd2-a133-3d8319f9494a => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 04 19:13:45.086449 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-b6bddfac-6f50-49e9-8ac6-665f15d3a226 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-85652838", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-630419074", "security_groups": [{"name": "tempest-secgroup-smoke-329240155"}], "block_device_mapping_v2": [{"uuid": "7d72d0ef-50c5-4234-845a-8c1be9cbe341", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f15a6490-097f-4027-b3d2-f33625a578b7"}]}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:13:45.208385 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.network.neutron [None req-b6bddfac-6f50-49e9-8ac6-665f15d3a226 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] validate_networks() for [('f15a6490-097f-4027-b3d2-f33625a578b7', None, None, None, None, None)] {{(pid=117124) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 04 19:13:45.950380 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-b6bddfac-6f50-49e9-8ac6-665f15d3a226 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Flavor limits 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 04 19:13:45.950870 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-b6bddfac-6f50-49e9-8ac6-665f15d3a226 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Image limits 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 04 19:13:45.951528 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-b6bddfac-6f50-49e9-8ac6-665f15d3a226 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Flavor pref 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 04 19:13:45.952436 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-b6bddfac-6f50-49e9-8ac6-665f15d3a226 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Image pref 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 04 19:13:45.952436 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-b6bddfac-6f50-49e9-8ac6-665f15d3a226 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 04 19:13:45.973253 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b6bddfac-6f50-49e9-8ac6-665f15d3a226 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:45.975275 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b6bddfac-6f50-49e9-8ac6-665f15d3a226 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:45.976279 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b6bddfac-6f50-49e9-8ac6-665f15d3a226 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:45.979723 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b6bddfac-6f50-49e9-8ac6-665f15d3a226 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:45.996949 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-b6bddfac-6f50-49e9-8ac6-665f15d3a226 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Getting quotas for project 157e9c40125e42b4b5a908fc58bfa939. Resources: {'cores', 'ram', 'instances'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 04 19:13:46.011540 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-b6bddfac-6f50-49e9-8ac6-665f15d3a226 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Getting quotas for user 3c8b295066bc4ae695f6e60b9b3dc5dd and project 157e9c40125e42b4b5a908fc58bfa939. Resources: {'cores', 'ram', 'instances'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 04 19:13:46.075423 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-b6bddfac-6f50-49e9-8ac6-665f15d3a226 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Going to run 1 instances... {{(pid=117124) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 04 19:13:46.077763 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-b6bddfac-6f50-49e9-8ac6-665f15d3a226 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: bf80016c-70bb-49d8-8c94-1f44a76084ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7d72d0ef-50c5-4234-845a-8c1be9cbe341',volume_size=None,volume_type=None)] {{(pid=117124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 04 19:13:46.247419 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-b6bddfac-6f50-49e9-8ac6-665f15d3a226 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.165556 May 04 19:13:46.256016 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 478/941] 10.222.0.69 () {60 vars in 1146 bytes} [Wed May 4 19:13:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 1175 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 04 19:13:46.262552 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-9a6b6d7a-e937-4993-9f36-3eb652242ae5 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:13:46.263166 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-9a6b6d7a-e937-4993-9f36-3eb652242ae5 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: bf80016c-70bb-49d8-8c94-1f44a76084ac] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:13:46.339196 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-9a6b6d7a-e937-4993-9f36-3eb652242ae5 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8b295066bc4ae695f6e60b9b3dc5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157e9c40125e42b4b5a908fc58bfa939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:13:46.347718 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-9a6b6d7a-e937-4993-9f36-3eb652242ae5 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "GET /compute/v2.1/servers/bf80016c-70bb-49d8-8c94-1f44a76084ac" status: 200 len: 1092 microversion: 2.1 time: 0.090523 May 04 19:13:46.348519 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 464/942] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:13:46 2022] GET /compute/v2.1/servers/bf80016c-70bb-49d8-8c94-1f44a76084ac => generated 1092 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:13:47.367789 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-c5ddff8f-e43f-4e92-a09d-29708f93e4ce tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:13:47.369330 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-c5ddff8f-e43f-4e92-a09d-29708f93e4ce tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: bf80016c-70bb-49d8-8c94-1f44a76084ac] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:13:47.383811 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c5ddff8f-e43f-4e92-a09d-29708f93e4ce tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:47.388014 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c5ddff8f-e43f-4e92-a09d-29708f93e4ce tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:47.389387 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c5ddff8f-e43f-4e92-a09d-29708f93e4ce tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:47.389869 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c5ddff8f-e43f-4e92-a09d-29708f93e4ce tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:47.502193 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-c5ddff8f-e43f-4e92-a09d-29708f93e4ce tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8b295066bc4ae695f6e60b9b3dc5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157e9c40125e42b4b5a908fc58bfa939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:13:47.518810 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-c5ddff8f-e43f-4e92-a09d-29708f93e4ce tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "GET /compute/v2.1/servers/bf80016c-70bb-49d8-8c94-1f44a76084ac" status: 200 len: 1190 microversion: 2.1 time: 0.156990 May 04 19:13:47.519397 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 479/943] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:13:47 2022] GET /compute/v2.1/servers/bf80016c-70bb-49d8-8c94-1f44a76084ac => generated 1190 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:13:48.538079 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-1bf7b29c-d1d8-4092-ad32-782fe6804778 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:13:48.538698 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-1bf7b29c-d1d8-4092-ad32-782fe6804778 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: bf80016c-70bb-49d8-8c94-1f44a76084ac] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:13:48.555987 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1bf7b29c-d1d8-4092-ad32-782fe6804778 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:48.557023 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1bf7b29c-d1d8-4092-ad32-782fe6804778 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:48.557978 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1bf7b29c-d1d8-4092-ad32-782fe6804778 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:48.558487 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1bf7b29c-d1d8-4092-ad32-782fe6804778 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:48.847581 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-1bf7b29c-d1d8-4092-ad32-782fe6804778 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8b295066bc4ae695f6e60b9b3dc5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157e9c40125e42b4b5a908fc58bfa939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:13:48.859139 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-1bf7b29c-d1d8-4092-ad32-782fe6804778 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "GET /compute/v2.1/servers/bf80016c-70bb-49d8-8c94-1f44a76084ac" status: 200 len: 1275 microversion: 2.1 time: 0.326545 May 04 19:13:48.862063 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 465/944] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:13:48 2022] GET /compute/v2.1/servers/bf80016c-70bb-49d8-8c94-1f44a76084ac => generated 1275 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:13:49.880103 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-34030e78-1277-4fe1-af39-0a04b8807781 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:13:49.880590 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-34030e78-1277-4fe1-af39-0a04b8807781 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: bf80016c-70bb-49d8-8c94-1f44a76084ac] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:13:49.887522 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-34030e78-1277-4fe1-af39-0a04b8807781 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:49.887851 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-34030e78-1277-4fe1-af39-0a04b8807781 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:49.888812 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-34030e78-1277-4fe1-af39-0a04b8807781 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:49.889441 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-34030e78-1277-4fe1-af39-0a04b8807781 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:50.171523 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-34030e78-1277-4fe1-af39-0a04b8807781 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8b295066bc4ae695f6e60b9b3dc5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157e9c40125e42b4b5a908fc58bfa939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:13:50.179848 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-34030e78-1277-4fe1-af39-0a04b8807781 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "GET /compute/v2.1/servers/bf80016c-70bb-49d8-8c94-1f44a76084ac" status: 200 len: 1263 microversion: 2.1 time: 0.305527 May 04 19:13:50.184955 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 480/945] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:13:49 2022] GET /compute/v2.1/servers/bf80016c-70bb-49d8-8c94-1f44a76084ac => generated 1263 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:13:50.295590 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-7d108897-9e8b-400d-9338-3e4a8c465be7 req-b44e06b1-f18f-4525-9a5b-28009e53a9c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf80016c-70bb-49d8-8c94-1f44a76084ac", "tag": "bbd412e0-d285-4a86-9b3a-addb7dfbd08b"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:13:50.315659 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-7d108897-9e8b-400d-9338-3e4a8c465be7 req-b44e06b1-f18f-4525-9a5b-28009e53a9c9 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:50.316107 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-7d108897-9e8b-400d-9338-3e4a8c465be7 req-b44e06b1-f18f-4525-9a5b-28009e53a9c9 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:50.352665 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-7d108897-9e8b-400d-9338-3e4a8c465be7 req-b44e06b1-f18f-4525-9a5b-28009e53a9c9 service nova] Creating event network-changed:bbd412e0-d285-4a86-9b3a-addb7dfbd08b for instance bf80016c-70bb-49d8-8c94-1f44a76084ac on hv-cinder-83090 May 04 19:13:50.362058 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-7d108897-9e8b-400d-9338-3e4a8c465be7 req-b44e06b1-f18f-4525-9a5b-28009e53a9c9 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075987 May 04 19:13:50.364647 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 466/946] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:13:51.199257 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-fe5fb2f0-0a82-4771-863b-a1596af15d13 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:13:51.199881 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-fe5fb2f0-0a82-4771-863b-a1596af15d13 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: bf80016c-70bb-49d8-8c94-1f44a76084ac] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:13:51.207189 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fe5fb2f0-0a82-4771-863b-a1596af15d13 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:51.207727 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fe5fb2f0-0a82-4771-863b-a1596af15d13 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:51.208492 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fe5fb2f0-0a82-4771-863b-a1596af15d13 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:51.208928 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-fe5fb2f0-0a82-4771-863b-a1596af15d13 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:51.509647 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-fe5fb2f0-0a82-4771-863b-a1596af15d13 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8b295066bc4ae695f6e60b9b3dc5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157e9c40125e42b4b5a908fc58bfa939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:13:51.536860 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-fe5fb2f0-0a82-4771-863b-a1596af15d13 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "GET /compute/v2.1/servers/bf80016c-70bb-49d8-8c94-1f44a76084ac" status: 200 len: 1263 microversion: 2.1 time: 0.341247 May 04 19:13:51.556621 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 481/947] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:13:51 2022] GET /compute/v2.1/servers/bf80016c-70bb-49d8-8c94-1f44a76084ac => generated 1263 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:13:52.567146 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-49d1c833-8f0a-41da-a2fd-714795758965 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:13:52.567859 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-49d1c833-8f0a-41da-a2fd-714795758965 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: bf80016c-70bb-49d8-8c94-1f44a76084ac] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:13:52.574769 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-49d1c833-8f0a-41da-a2fd-714795758965 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:52.575210 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-49d1c833-8f0a-41da-a2fd-714795758965 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:52.576312 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-49d1c833-8f0a-41da-a2fd-714795758965 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:52.576989 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-49d1c833-8f0a-41da-a2fd-714795758965 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:52.799539 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-49d1c833-8f0a-41da-a2fd-714795758965 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8b295066bc4ae695f6e60b9b3dc5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157e9c40125e42b4b5a908fc58bfa939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:13:52.810813 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-49d1c833-8f0a-41da-a2fd-714795758965 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "GET /compute/v2.1/servers/bf80016c-70bb-49d8-8c94-1f44a76084ac" status: 200 len: 1263 microversion: 2.1 time: 0.244340 May 04 19:13:52.811440 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 467/948] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:13:52 2022] GET /compute/v2.1/servers/bf80016c-70bb-49d8-8c94-1f44a76084ac => generated 1263 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:13:53.833455 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-7ba834cc-c5c1-40fc-875d-334042fc9d2c tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:13:53.835721 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-7ba834cc-c5c1-40fc-875d-334042fc9d2c tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: bf80016c-70bb-49d8-8c94-1f44a76084ac] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:13:53.851538 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7ba834cc-c5c1-40fc-875d-334042fc9d2c tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:53.853598 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7ba834cc-c5c1-40fc-875d-334042fc9d2c tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:53.857498 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7ba834cc-c5c1-40fc-875d-334042fc9d2c tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:53.858214 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7ba834cc-c5c1-40fc-875d-334042fc9d2c tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:54.140685 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-7ba834cc-c5c1-40fc-875d-334042fc9d2c tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8b295066bc4ae695f6e60b9b3dc5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157e9c40125e42b4b5a908fc58bfa939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:13:54.156474 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-7ba834cc-c5c1-40fc-875d-334042fc9d2c tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "GET /compute/v2.1/servers/bf80016c-70bb-49d8-8c94-1f44a76084ac" status: 200 len: 1263 microversion: 2.1 time: 0.332820 May 04 19:13:54.159167 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 482/949] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:13:53 2022] GET /compute/v2.1/servers/bf80016c-70bb-49d8-8c94-1f44a76084ac => generated 1263 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:13:55.176546 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-ce567a52-dc10-44ed-96b7-62ce23b590de tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:13:55.177217 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-ce567a52-dc10-44ed-96b7-62ce23b590de tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: bf80016c-70bb-49d8-8c94-1f44a76084ac] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:13:55.186256 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ce567a52-dc10-44ed-96b7-62ce23b590de tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:55.186708 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ce567a52-dc10-44ed-96b7-62ce23b590de tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:55.187493 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ce567a52-dc10-44ed-96b7-62ce23b590de tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:55.188829 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ce567a52-dc10-44ed-96b7-62ce23b590de tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:55.398765 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-ce567a52-dc10-44ed-96b7-62ce23b590de tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8b295066bc4ae695f6e60b9b3dc5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157e9c40125e42b4b5a908fc58bfa939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:13:55.406606 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-ce567a52-dc10-44ed-96b7-62ce23b590de tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "GET /compute/v2.1/servers/bf80016c-70bb-49d8-8c94-1f44a76084ac" status: 200 len: 1263 microversion: 2.1 time: 0.234238 May 04 19:13:55.408665 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 468/950] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:13:55 2022] GET /compute/v2.1/servers/bf80016c-70bb-49d8-8c94-1f44a76084ac => generated 1263 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:13:56.425569 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-91ffc9c8-bfe5-4971-a5ea-b3119987e095 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:13:56.428151 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-91ffc9c8-bfe5-4971-a5ea-b3119987e095 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: bf80016c-70bb-49d8-8c94-1f44a76084ac] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:13:56.439474 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-91ffc9c8-bfe5-4971-a5ea-b3119987e095 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:56.440651 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-91ffc9c8-bfe5-4971-a5ea-b3119987e095 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:56.441811 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-91ffc9c8-bfe5-4971-a5ea-b3119987e095 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:56.442466 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-91ffc9c8-bfe5-4971-a5ea-b3119987e095 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:56.766514 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-91ffc9c8-bfe5-4971-a5ea-b3119987e095 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8b295066bc4ae695f6e60b9b3dc5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157e9c40125e42b4b5a908fc58bfa939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:13:56.777524 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-91ffc9c8-bfe5-4971-a5ea-b3119987e095 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "GET /compute/v2.1/servers/bf80016c-70bb-49d8-8c94-1f44a76084ac" status: 200 len: 1263 microversion: 2.1 time: 0.355031 May 04 19:13:56.780023 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 483/951] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:13:56 2022] GET /compute/v2.1/servers/bf80016c-70bb-49d8-8c94-1f44a76084ac => generated 1263 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:13:57.796051 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-0303c1c1-2f95-4612-8445-9133e3b1933c tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:13:57.796667 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-0303c1c1-2f95-4612-8445-9133e3b1933c tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: bf80016c-70bb-49d8-8c94-1f44a76084ac] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:13:57.814267 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0303c1c1-2f95-4612-8445-9133e3b1933c tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:57.815019 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0303c1c1-2f95-4612-8445-9133e3b1933c tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:57.816157 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0303c1c1-2f95-4612-8445-9133e3b1933c tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:57.816818 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0303c1c1-2f95-4612-8445-9133e3b1933c tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:58.213580 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-0303c1c1-2f95-4612-8445-9133e3b1933c tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8b295066bc4ae695f6e60b9b3dc5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157e9c40125e42b4b5a908fc58bfa939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:13:58.228973 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-0303c1c1-2f95-4612-8445-9133e3b1933c tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "GET /compute/v2.1/servers/bf80016c-70bb-49d8-8c94-1f44a76084ac" status: 200 len: 1263 microversion: 2.1 time: 0.435313 May 04 19:13:58.230671 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 469/952] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:13:57 2022] GET /compute/v2.1/servers/bf80016c-70bb-49d8-8c94-1f44a76084ac => generated 1263 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:13:59.249330 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-83f875dd-89f0-46e6-9281-c82ad64b533a tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:13:59.251553 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-83f875dd-89f0-46e6-9281-c82ad64b533a tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: bf80016c-70bb-49d8-8c94-1f44a76084ac] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:13:59.260607 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-83f875dd-89f0-46e6-9281-c82ad64b533a tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:59.261072 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-83f875dd-89f0-46e6-9281-c82ad64b533a tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:59.261923 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-83f875dd-89f0-46e6-9281-c82ad64b533a tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:13:59.262365 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-83f875dd-89f0-46e6-9281-c82ad64b533a tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:13:59.598305 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-83f875dd-89f0-46e6-9281-c82ad64b533a tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8b295066bc4ae695f6e60b9b3dc5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157e9c40125e42b4b5a908fc58bfa939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:13:59.605793 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-83f875dd-89f0-46e6-9281-c82ad64b533a tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "GET /compute/v2.1/servers/bf80016c-70bb-49d8-8c94-1f44a76084ac" status: 200 len: 1263 microversion: 2.1 time: 0.360263 May 04 19:13:59.611017 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 484/953] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:13:59 2022] GET /compute/v2.1/servers/bf80016c-70bb-49d8-8c94-1f44a76084ac => generated 1263 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:14:00.627393 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-2a21162c-5769-43b1-b014-296d20409ece tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:14:00.628017 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-2a21162c-5769-43b1-b014-296d20409ece tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: bf80016c-70bb-49d8-8c94-1f44a76084ac] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:14:00.646529 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2a21162c-5769-43b1-b014-296d20409ece tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:00.647019 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2a21162c-5769-43b1-b014-296d20409ece tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:00.650970 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2a21162c-5769-43b1-b014-296d20409ece tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:00.651426 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2a21162c-5769-43b1-b014-296d20409ece tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:01.043463 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-2a21162c-5769-43b1-b014-296d20409ece tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8b295066bc4ae695f6e60b9b3dc5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157e9c40125e42b4b5a908fc58bfa939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:14:01.053097 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-2a21162c-5769-43b1-b014-296d20409ece tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "GET /compute/v2.1/servers/bf80016c-70bb-49d8-8c94-1f44a76084ac" status: 200 len: 1263 microversion: 2.1 time: 0.431712 May 04 19:14:01.056344 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 470/954] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:14:00 2022] GET /compute/v2.1/servers/bf80016c-70bb-49d8-8c94-1f44a76084ac => generated 1263 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:14:02.073422 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-9f992862-3cae-4fec-87b0-cf770c84c7a1 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:14:02.074075 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-9f992862-3cae-4fec-87b0-cf770c84c7a1 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: bf80016c-70bb-49d8-8c94-1f44a76084ac] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:14:02.085524 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9f992862-3cae-4fec-87b0-cf770c84c7a1 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:02.086239 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9f992862-3cae-4fec-87b0-cf770c84c7a1 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:02.091105 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9f992862-3cae-4fec-87b0-cf770c84c7a1 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:02.093079 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9f992862-3cae-4fec-87b0-cf770c84c7a1 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:02.438088 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-9f992862-3cae-4fec-87b0-cf770c84c7a1 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8b295066bc4ae695f6e60b9b3dc5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157e9c40125e42b4b5a908fc58bfa939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:14:02.454340 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-9f992862-3cae-4fec-87b0-cf770c84c7a1 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "GET /compute/v2.1/servers/bf80016c-70bb-49d8-8c94-1f44a76084ac" status: 200 len: 1263 microversion: 2.1 time: 0.385332 May 04 19:14:02.455631 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 485/955] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:14:02 2022] GET /compute/v2.1/servers/bf80016c-70bb-49d8-8c94-1f44a76084ac => generated 1263 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:14:02.499799 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-6eabaa16-3e17-491f-8751-f22668f79f51 req-01eb332f-51ff-46e1-ac99-d739aa5c85f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf80016c-70bb-49d8-8c94-1f44a76084ac", "name": "network-vif-plugged", "status": "completed", "tag": "bbd412e0-d285-4a86-9b3a-addb7dfbd08b"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:14:02.523849 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-6eabaa16-3e17-491f-8751-f22668f79f51 req-01eb332f-51ff-46e1-ac99-d739aa5c85f4 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:02.527970 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-6eabaa16-3e17-491f-8751-f22668f79f51 req-01eb332f-51ff-46e1-ac99-d739aa5c85f4 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:02.555773 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-6eabaa16-3e17-491f-8751-f22668f79f51 req-01eb332f-51ff-46e1-ac99-d739aa5c85f4 service nova] Creating event network-vif-plugged:bbd412e0-d285-4a86-9b3a-addb7dfbd08b for instance bf80016c-70bb-49d8-8c94-1f44a76084ac on hv-cinder-83090 May 04 19:14:02.566211 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-6eabaa16-3e17-491f-8751-f22668f79f51 req-01eb332f-51ff-46e1-ac99-d739aa5c85f4 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071768 May 04 19:14:02.581397 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 471/956] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 04 19:14:03.473830 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-1df51f8d-e4d9-4445-9409-cf51b95888f2 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:14:03.474606 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-1df51f8d-e4d9-4445-9409-cf51b95888f2 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: bf80016c-70bb-49d8-8c94-1f44a76084ac] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:14:03.488259 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1df51f8d-e4d9-4445-9409-cf51b95888f2 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:03.489349 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1df51f8d-e4d9-4445-9409-cf51b95888f2 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:03.491984 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1df51f8d-e4d9-4445-9409-cf51b95888f2 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:03.494302 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1df51f8d-e4d9-4445-9409-cf51b95888f2 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:03.889207 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-1df51f8d-e4d9-4445-9409-cf51b95888f2 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8b295066bc4ae695f6e60b9b3dc5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157e9c40125e42b4b5a908fc58bfa939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:14:03.901555 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-1df51f8d-e4d9-4445-9409-cf51b95888f2 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "GET /compute/v2.1/servers/bf80016c-70bb-49d8-8c94-1f44a76084ac" status: 200 len: 1263 microversion: 2.1 time: 0.431250 May 04 19:14:03.919151 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 486/957] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:14:03 2022] GET /compute/v2.1/servers/bf80016c-70bb-49d8-8c94-1f44a76084ac => generated 1263 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:14:04.920595 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-a86a02cb-642b-4efb-9767-41bec050daf4 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:14:04.922430 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-a86a02cb-642b-4efb-9767-41bec050daf4 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: bf80016c-70bb-49d8-8c94-1f44a76084ac] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:14:04.935369 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a86a02cb-642b-4efb-9767-41bec050daf4 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:04.937751 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a86a02cb-642b-4efb-9767-41bec050daf4 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:04.946334 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a86a02cb-642b-4efb-9767-41bec050daf4 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:04.947565 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-a86a02cb-642b-4efb-9767-41bec050daf4 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:05.425882 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-a86a02cb-642b-4efb-9767-41bec050daf4 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8b295066bc4ae695f6e60b9b3dc5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157e9c40125e42b4b5a908fc58bfa939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:14:05.436514 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-a86a02cb-642b-4efb-9767-41bec050daf4 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "GET /compute/v2.1/servers/bf80016c-70bb-49d8-8c94-1f44a76084ac" status: 200 len: 1451 microversion: 2.1 time: 0.520305 May 04 19:14:05.439317 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 472/958] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:14:04 2022] GET /compute/v2.1/servers/bf80016c-70bb-49d8-8c94-1f44a76084ac => generated 1451 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:14:05.455402 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-4a2ec6bd-8add-40c7-8dbc-7820d68f3bf0 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:14:05.455889 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-4a2ec6bd-8add-40c7-8dbc-7820d68f3bf0 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: bf80016c-70bb-49d8-8c94-1f44a76084ac] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:14:05.483625 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4a2ec6bd-8add-40c7-8dbc-7820d68f3bf0 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:05.484218 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4a2ec6bd-8add-40c7-8dbc-7820d68f3bf0 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:05.485054 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4a2ec6bd-8add-40c7-8dbc-7820d68f3bf0 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:05.485504 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4a2ec6bd-8add-40c7-8dbc-7820d68f3bf0 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:05.907185 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-4a2ec6bd-8add-40c7-8dbc-7820d68f3bf0 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8b295066bc4ae695f6e60b9b3dc5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157e9c40125e42b4b5a908fc58bfa939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:14:05.919876 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-4a2ec6bd-8add-40c7-8dbc-7820d68f3bf0 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "GET /compute/v2.1/servers/bf80016c-70bb-49d8-8c94-1f44a76084ac" status: 200 len: 1451 microversion: 2.1 time: 0.468800 May 04 19:14:05.926115 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 487/959] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:14:05 2022] GET /compute/v2.1/servers/bf80016c-70bb-49d8-8c94-1f44a76084ac => generated 1451 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:14:09.427207 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-50799e97-4ef4-4282-b5e6-caddb1ead3c3 req-4e1c45d2-e0e9-4f41-8737-2d8495554824 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf80016c-70bb-49d8-8c94-1f44a76084ac", "tag": "bbd412e0-d285-4a86-9b3a-addb7dfbd08b"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:14:09.452756 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-50799e97-4ef4-4282-b5e6-caddb1ead3c3 req-4e1c45d2-e0e9-4f41-8737-2d8495554824 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:09.453488 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-50799e97-4ef4-4282-b5e6-caddb1ead3c3 req-4e1c45d2-e0e9-4f41-8737-2d8495554824 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:09.488799 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-50799e97-4ef4-4282-b5e6-caddb1ead3c3 req-4e1c45d2-e0e9-4f41-8737-2d8495554824 service nova] Creating event network-changed:bbd412e0-d285-4a86-9b3a-addb7dfbd08b for instance bf80016c-70bb-49d8-8c94-1f44a76084ac on hv-cinder-83090 May 04 19:14:09.514678 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-50799e97-4ef4-4282-b5e6-caddb1ead3c3 req-4e1c45d2-e0e9-4f41-8737-2d8495554824 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089167 May 04 19:14:09.515559 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 473/960] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:14:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:14:14.115539 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-eec56b90-cc66-43a6-9e07-1e8c43a6c793 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1294794623", "imageRef": "2869595e-cda4-45af-aaeb-0779eb5f4114", "flavorRef": "452"}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:14:14.218812 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.network.neutron [None req-eec56b90-cc66-43a6-9e07-1e8c43a6c793 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] validate_networks() for None {{(pid=117124) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 04 19:14:15.112409 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-eec56b90-cc66-43a6-9e07-1e8c43a6c793 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Flavor limits 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 04 19:14:15.115340 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-eec56b90-cc66-43a6-9e07-1e8c43a6c793 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Image limits 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 04 19:14:15.115872 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-eec56b90-cc66-43a6-9e07-1e8c43a6c793 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Flavor pref 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 04 19:14:15.116926 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-eec56b90-cc66-43a6-9e07-1e8c43a6c793 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Image pref 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 04 19:14:15.118053 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-eec56b90-cc66-43a6-9e07-1e8c43a6c793 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 04 19:14:15.133886 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-eec56b90-cc66-43a6-9e07-1e8c43a6c793 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:15.134609 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-eec56b90-cc66-43a6-9e07-1e8c43a6c793 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:15.136006 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-eec56b90-cc66-43a6-9e07-1e8c43a6c793 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:15.138169 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-eec56b90-cc66-43a6-9e07-1e8c43a6c793 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:15.188200 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-eec56b90-cc66-43a6-9e07-1e8c43a6c793 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Getting quotas for project 3c331adb2d6541efbab26b5e11c096be. Resources: {'cores', 'ram', 'instances'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 04 19:14:15.192853 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-eec56b90-cc66-43a6-9e07-1e8c43a6c793 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Getting quotas for user 2fbc2486d3ef49b79d8422f25b6d0257 and project 3c331adb2d6541efbab26b5e11c096be. Resources: {'cores', 'ram', 'instances'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 04 19:14:15.219966 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-eec56b90-cc66-43a6-9e07-1e8c43a6c793 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Going to run 1 instances... {{(pid=117124) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 04 19:14:15.227984 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-eec56b90-cc66-43a6-9e07-1e8c43a6c793 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] [instance: 6fd089f1-5724-405f-8e78-55229c68003e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2869595e-cda4-45af-aaeb-0779eb5f4114',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 04 19:14:15.320973 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-eec56b90-cc66-43a6-9e07-1e8c43a6c793 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.213481 May 04 19:14:15.333956 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-ce5b138c-10e7-4fb3-b976-357ad904f372 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:14:15.335246 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-ce5b138c-10e7-4fb3-b976-357ad904f372 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] [instance: 6fd089f1-5724-405f-8e78-55229c68003e] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:14:15.339222 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 488/961] 10.222.0.69 () {60 vars in 1146 bytes} [Wed May 4 19:14:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1234 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 04 19:14:15.450926 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-ce5b138c-10e7-4fb3-b976-357ad904f372 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbc2486d3ef49b79d8422f25b6d0257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c331adb2d6541efbab26b5e11c096be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:14:15.459935 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-ce5b138c-10e7-4fb3-b976-357ad904f372 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] 10.222.0.69 "GET /compute/v2.1/servers/6fd089f1-5724-405f-8e78-55229c68003e" status: 200 len: 1215 microversion: 2.1 time: 0.131608 May 04 19:14:15.485049 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 474/962] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:14:15 2022] GET /compute/v2.1/servers/6fd089f1-5724-405f-8e78-55229c68003e => generated 1215 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:14:16.479473 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-cb685ba4-c382-4471-b4a5-ff648e979b76 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:14:16.481012 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-cb685ba4-c382-4471-b4a5-ff648e979b76 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] [instance: 6fd089f1-5724-405f-8e78-55229c68003e] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:14:16.499857 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-cb685ba4-c382-4471-b4a5-ff648e979b76 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:16.500579 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-cb685ba4-c382-4471-b4a5-ff648e979b76 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:16.501627 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-cb685ba4-c382-4471-b4a5-ff648e979b76 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:16.502226 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-cb685ba4-c382-4471-b4a5-ff648e979b76 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:16.628852 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-cb685ba4-c382-4471-b4a5-ff648e979b76 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbc2486d3ef49b79d8422f25b6d0257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c331adb2d6541efbab26b5e11c096be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:14:16.640179 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-cb685ba4-c382-4471-b4a5-ff648e979b76 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] 10.222.0.69 "GET /compute/v2.1/servers/6fd089f1-5724-405f-8e78-55229c68003e" status: 200 len: 1211 microversion: 2.1 time: 0.166421 May 04 19:14:16.654329 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 489/963] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:14:16 2022] GET /compute/v2.1/servers/6fd089f1-5724-405f-8e78-55229c68003e => generated 1211 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:14:17.659034 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-8aa95af3-3ec6-4df0-b232-8c8fc842518b tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:14:17.660356 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-8aa95af3-3ec6-4df0-b232-8c8fc842518b tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] [instance: 6fd089f1-5724-405f-8e78-55229c68003e] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:14:17.686219 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8aa95af3-3ec6-4df0-b232-8c8fc842518b tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:17.688847 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8aa95af3-3ec6-4df0-b232-8c8fc842518b tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:17.695146 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8aa95af3-3ec6-4df0-b232-8c8fc842518b tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:17.696805 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8aa95af3-3ec6-4df0-b232-8c8fc842518b tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:17.874848 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-8aa95af3-3ec6-4df0-b232-8c8fc842518b tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbc2486d3ef49b79d8422f25b6d0257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c331adb2d6541efbab26b5e11c096be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:14:17.886082 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-8aa95af3-3ec6-4df0-b232-8c8fc842518b tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] 10.222.0.69 "GET /compute/v2.1/servers/6fd089f1-5724-405f-8e78-55229c68003e" status: 200 len: 1273 microversion: 2.1 time: 0.228241 May 04 19:14:17.886815 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 475/964] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:14:17 2022] GET /compute/v2.1/servers/6fd089f1-5724-405f-8e78-55229c68003e => generated 1273 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:14:18.224429 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-e10b865c-4391-445a-ac83-03b2fdb633e0 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Action: 'create', calling method: .version_select at 0x7fc3f61e9280>, body: {"keypair": {"name": "tempest-TestShelveInstance-97506937"}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:14:18.268465 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-e10b865c-4391-445a-ac83-03b2fdb633e0 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Getting quotas for project cc0c73a5efc84e348363ae368873f51d. Resources: {'key_pairs'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 04 19:14:18.285117 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-e10b865c-4391-445a-ac83-03b2fdb633e0 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Getting quotas for user 1fa0cd8ed723418daf1cbd6933e0ce6b and project cc0c73a5efc84e348363ae368873f51d. Resources: {'key_pairs'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 04 19:14:18.644411 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-e10b865c-4391-445a-ac83-03b2fdb633e0 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Getting quotas for project cc0c73a5efc84e348363ae368873f51d. Resources: {'key_pairs'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 04 19:14:18.650061 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-e10b865c-4391-445a-ac83-03b2fdb633e0 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Getting quotas for user 1fa0cd8ed723418daf1cbd6933e0ce6b and project cc0c73a5efc84e348363ae368873f51d. Resources: {'key_pairs'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 04 19:14:18.669285 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-e10b865c-4391-445a-ac83-03b2fdb633e0 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 2314 microversion: 2.1 time: 0.851626 May 04 19:14:18.677160 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 490/965] 10.222.0.69 () {60 vars in 1157 bytes} [Wed May 4 19:14:17 2022] POST /compute/v2.1/os-keypairs => generated 2314 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:14:18.911646 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-0e78b63c-9693-4dc8-9a17-ef9601d57fed tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:14:18.913335 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-0e78b63c-9693-4dc8-9a17-ef9601d57fed tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] [instance: 6fd089f1-5724-405f-8e78-55229c68003e] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:14:18.930944 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0e78b63c-9693-4dc8-9a17-ef9601d57fed tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:18.933392 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0e78b63c-9693-4dc8-9a17-ef9601d57fed tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:18.934597 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0e78b63c-9693-4dc8-9a17-ef9601d57fed tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:18.935262 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0e78b63c-9693-4dc8-9a17-ef9601d57fed tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:19.030247 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-0e78b63c-9693-4dc8-9a17-ef9601d57fed tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbc2486d3ef49b79d8422f25b6d0257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c331adb2d6541efbab26b5e11c096be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:14:19.047728 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-0e78b63c-9693-4dc8-9a17-ef9601d57fed tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] 10.222.0.69 "GET /compute/v2.1/servers/6fd089f1-5724-405f-8e78-55229c68003e" status: 200 len: 1273 microversion: 2.1 time: 0.144955 May 04 19:14:19.060953 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 476/966] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:14:18 2022] GET /compute/v2.1/servers/6fd089f1-5724-405f-8e78-55229c68003e => generated 1273 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:14:20.067023 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-04a5dc24-e326-4895-a8d4-c3934ae2f28e tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:14:20.068086 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-04a5dc24-e326-4895-a8d4-c3934ae2f28e tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] [instance: 6fd089f1-5724-405f-8e78-55229c68003e] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:14:20.078646 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-04a5dc24-e326-4895-a8d4-c3934ae2f28e tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:20.079105 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-04a5dc24-e326-4895-a8d4-c3934ae2f28e tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:20.079894 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-04a5dc24-e326-4895-a8d4-c3934ae2f28e tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:20.080334 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-04a5dc24-e326-4895-a8d4-c3934ae2f28e tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:20.416933 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-04a5dc24-e326-4895-a8d4-c3934ae2f28e tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbc2486d3ef49b79d8422f25b6d0257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c331adb2d6541efbab26b5e11c096be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:14:20.428196 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-04a5dc24-e326-4895-a8d4-c3934ae2f28e tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] 10.222.0.69 "GET /compute/v2.1/servers/6fd089f1-5724-405f-8e78-55229c68003e" status: 200 len: 1315 microversion: 2.1 time: 0.362320 May 04 19:14:20.429369 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 491/967] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:14:20 2022] GET /compute/v2.1/servers/6fd089f1-5724-405f-8e78-55229c68003e => generated 1315 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:14:21.447801 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-0c335ef0-4094-4bd6-98d7-2edd61e4644a tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:14:21.448518 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-0c335ef0-4094-4bd6-98d7-2edd61e4644a tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] [instance: 6fd089f1-5724-405f-8e78-55229c68003e] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:14:21.455887 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0c335ef0-4094-4bd6-98d7-2edd61e4644a tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:21.456566 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0c335ef0-4094-4bd6-98d7-2edd61e4644a tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:21.457573 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0c335ef0-4094-4bd6-98d7-2edd61e4644a tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:21.458398 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0c335ef0-4094-4bd6-98d7-2edd61e4644a tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:21.671542 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-0c335ef0-4094-4bd6-98d7-2edd61e4644a tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbc2486d3ef49b79d8422f25b6d0257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c331adb2d6541efbab26b5e11c096be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:14:21.684631 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-0c335ef0-4094-4bd6-98d7-2edd61e4644a tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] 10.222.0.69 "GET /compute/v2.1/servers/6fd089f1-5724-405f-8e78-55229c68003e" status: 200 len: 1315 microversion: 2.1 time: 0.242434 May 04 19:14:21.686955 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 477/968] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:14:21 2022] GET /compute/v2.1/servers/6fd089f1-5724-405f-8e78-55229c68003e => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:14:21.705665 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-33777b8c-5168-45df-8f0e-d05ae9acd376 req-6abf8ad2-8e7d-44da-bf5b-6dd9a28d9d97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fd089f1-5724-405f-8e78-55229c68003e", "tag": "f2103973-576f-433f-b089-452e0e426f37"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:14:21.723259 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-33777b8c-5168-45df-8f0e-d05ae9acd376 req-6abf8ad2-8e7d-44da-bf5b-6dd9a28d9d97 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:21.741220 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-33777b8c-5168-45df-8f0e-d05ae9acd376 req-6abf8ad2-8e7d-44da-bf5b-6dd9a28d9d97 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:21.770476 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-33777b8c-5168-45df-8f0e-d05ae9acd376 req-6abf8ad2-8e7d-44da-bf5b-6dd9a28d9d97 service nova] Creating event network-changed:f2103973-576f-433f-b089-452e0e426f37 for instance 6fd089f1-5724-405f-8e78-55229c68003e on hv-cinder-83090 May 04 19:14:21.781583 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-33777b8c-5168-45df-8f0e-d05ae9acd376 req-6abf8ad2-8e7d-44da-bf5b-6dd9a28d9d97 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080955 May 04 19:14:21.783848 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 492/969] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:14:22.702800 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-57563e4d-956f-4a73-b3bb-618f28cdfef2 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:14:22.703331 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-57563e4d-956f-4a73-b3bb-618f28cdfef2 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] [instance: 6fd089f1-5724-405f-8e78-55229c68003e] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:14:22.712422 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-57563e4d-956f-4a73-b3bb-618f28cdfef2 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:22.712875 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-57563e4d-956f-4a73-b3bb-618f28cdfef2 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:22.713691 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-57563e4d-956f-4a73-b3bb-618f28cdfef2 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:22.714133 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-57563e4d-956f-4a73-b3bb-618f28cdfef2 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:22.951208 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-57563e4d-956f-4a73-b3bb-618f28cdfef2 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbc2486d3ef49b79d8422f25b6d0257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c331adb2d6541efbab26b5e11c096be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:14:22.978240 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-57563e4d-956f-4a73-b3bb-618f28cdfef2 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] 10.222.0.69 "GET /compute/v2.1/servers/6fd089f1-5724-405f-8e78-55229c68003e" status: 200 len: 1315 microversion: 2.1 time: 0.270819 May 04 19:14:22.979111 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 478/970] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:14:22 2022] GET /compute/v2.1/servers/6fd089f1-5724-405f-8e78-55229c68003e => generated 1315 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:14:23.998669 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-2a3d8e31-0770-47f6-823f-4f96580ec35f tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:14:24.000620 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-2a3d8e31-0770-47f6-823f-4f96580ec35f tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] [instance: 6fd089f1-5724-405f-8e78-55229c68003e] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:14:24.008540 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2a3d8e31-0770-47f6-823f-4f96580ec35f tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:24.009204 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2a3d8e31-0770-47f6-823f-4f96580ec35f tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:24.010576 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2a3d8e31-0770-47f6-823f-4f96580ec35f tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:24.011206 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2a3d8e31-0770-47f6-823f-4f96580ec35f tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:24.306343 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-2a3d8e31-0770-47f6-823f-4f96580ec35f tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbc2486d3ef49b79d8422f25b6d0257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c331adb2d6541efbab26b5e11c096be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:14:24.318269 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-2a3d8e31-0770-47f6-823f-4f96580ec35f tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] 10.222.0.69 "GET /compute/v2.1/servers/6fd089f1-5724-405f-8e78-55229c68003e" status: 200 len: 1315 microversion: 2.1 time: 0.325750 May 04 19:14:24.318867 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 493/971] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:14:23 2022] GET /compute/v2.1/servers/6fd089f1-5724-405f-8e78-55229c68003e => generated 1315 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:14:25.346735 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-c92f54a5-b1da-4ef5-ba37-e71099912d22 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:14:25.347922 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-c92f54a5-b1da-4ef5-ba37-e71099912d22 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] [instance: 6fd089f1-5724-405f-8e78-55229c68003e] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:14:25.355060 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c92f54a5-b1da-4ef5-ba37-e71099912d22 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:25.356134 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c92f54a5-b1da-4ef5-ba37-e71099912d22 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:25.357258 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c92f54a5-b1da-4ef5-ba37-e71099912d22 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:25.357929 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c92f54a5-b1da-4ef5-ba37-e71099912d22 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:25.689819 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-c92f54a5-b1da-4ef5-ba37-e71099912d22 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbc2486d3ef49b79d8422f25b6d0257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c331adb2d6541efbab26b5e11c096be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:14:25.701226 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-c92f54a5-b1da-4ef5-ba37-e71099912d22 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] 10.222.0.69 "GET /compute/v2.1/servers/6fd089f1-5724-405f-8e78-55229c68003e" status: 200 len: 1315 microversion: 2.1 time: 0.362486 May 04 19:14:25.719197 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 479/972] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:14:25 2022] GET /compute/v2.1/servers/6fd089f1-5724-405f-8e78-55229c68003e => generated 1315 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:14:26.719780 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-aa3c24f1-3426-425a-a0a8-849c1e3b864d tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:14:26.720766 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-aa3c24f1-3426-425a-a0a8-849c1e3b864d tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] [instance: 6fd089f1-5724-405f-8e78-55229c68003e] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:14:26.732117 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-aa3c24f1-3426-425a-a0a8-849c1e3b864d tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:26.732957 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-aa3c24f1-3426-425a-a0a8-849c1e3b864d tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:26.734019 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-aa3c24f1-3426-425a-a0a8-849c1e3b864d tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:26.735368 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-aa3c24f1-3426-425a-a0a8-849c1e3b864d tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:27.023015 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-aa3c24f1-3426-425a-a0a8-849c1e3b864d tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbc2486d3ef49b79d8422f25b6d0257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c331adb2d6541efbab26b5e11c096be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:14:27.031891 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-aa3c24f1-3426-425a-a0a8-849c1e3b864d tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] 10.222.0.69 "GET /compute/v2.1/servers/6fd089f1-5724-405f-8e78-55229c68003e" status: 200 len: 1315 microversion: 2.1 time: 0.316565 May 04 19:14:27.043178 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 494/973] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:14:26 2022] GET /compute/v2.1/servers/6fd089f1-5724-405f-8e78-55229c68003e => generated 1315 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:14:27.637882 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-53922e7e-37ef-48fa-a0e1-6b6df0aa61ce req-5df01e54-ff2e-410d-b96e-20a5d23b8df8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fd089f1-5724-405f-8e78-55229c68003e", "name": "network-vif-plugged", "status": "completed", "tag": "f2103973-576f-433f-b089-452e0e426f37"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:14:27.646738 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-53922e7e-37ef-48fa-a0e1-6b6df0aa61ce req-5df01e54-ff2e-410d-b96e-20a5d23b8df8 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:27.647092 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-53922e7e-37ef-48fa-a0e1-6b6df0aa61ce req-5df01e54-ff2e-410d-b96e-20a5d23b8df8 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:27.662778 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-53922e7e-37ef-48fa-a0e1-6b6df0aa61ce req-5df01e54-ff2e-410d-b96e-20a5d23b8df8 service nova] Creating event network-vif-plugged:f2103973-576f-433f-b089-452e0e426f37 for instance 6fd089f1-5724-405f-8e78-55229c68003e on hv-cinder-83090 May 04 19:14:27.668427 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-53922e7e-37ef-48fa-a0e1-6b6df0aa61ce req-5df01e54-ff2e-410d-b96e-20a5d23b8df8 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034179 May 04 19:14:27.669374 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 480/974] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:14:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:14:28.051453 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-58fd3f50-840e-466a-acc8-4610817ecf4c tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:14:28.052086 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-58fd3f50-840e-466a-acc8-4610817ecf4c tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] [instance: 6fd089f1-5724-405f-8e78-55229c68003e] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:14:28.059054 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-58fd3f50-840e-466a-acc8-4610817ecf4c tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:28.059702 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-58fd3f50-840e-466a-acc8-4610817ecf4c tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:28.060850 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-58fd3f50-840e-466a-acc8-4610817ecf4c tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:28.061452 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-58fd3f50-840e-466a-acc8-4610817ecf4c tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:28.238563 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-58fd3f50-840e-466a-acc8-4610817ecf4c tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbc2486d3ef49b79d8422f25b6d0257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c331adb2d6541efbab26b5e11c096be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:14:28.249103 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-58fd3f50-840e-466a-acc8-4610817ecf4c tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] 10.222.0.69 "GET /compute/v2.1/servers/6fd089f1-5724-405f-8e78-55229c68003e" status: 200 len: 1315 microversion: 2.1 time: 0.201737 May 04 19:14:28.249887 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 495/975] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:14:28 2022] GET /compute/v2.1/servers/6fd089f1-5724-405f-8e78-55229c68003e => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:14:28.830662 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-e117d704-858a-45c1-b88d-70abb8bdc21f tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Action: 'create', calling method: .version_select at 0x7fc3f606a160>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1493000720"}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:14:28.845390 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-e117d704-858a-45c1-b88d-70abb8bdc21f tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Getting quotas for project a92a32956353454db32509526ff751da. Resources: {'key_pairs'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 04 19:14:28.849159 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-e117d704-858a-45c1-b88d-70abb8bdc21f tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Getting quotas for user 0e0b0f5728f244578741648259bbcd59 and project a92a32956353454db32509526ff751da. Resources: {'key_pairs'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 04 19:14:29.135484 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-e117d704-858a-45c1-b88d-70abb8bdc21f tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Getting quotas for project a92a32956353454db32509526ff751da. Resources: {'key_pairs'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 04 19:14:29.138826 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-e117d704-858a-45c1-b88d-70abb8bdc21f tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Getting quotas for user 0e0b0f5728f244578741648259bbcd59 and project a92a32956353454db32509526ff751da. Resources: {'key_pairs'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 04 19:14:29.152969 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-e117d704-858a-45c1-b88d-70abb8bdc21f tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.327376 May 04 19:14:29.153928 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 481/976] 10.222.0.69 () {60 vars in 1157 bytes} [Wed May 4 19:14:28 2022] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:14:29.258228 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-065d7761-d253-4b3c-893c-cd3ff756f83f tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1803955174", "imageRef": "27aaf5e9-c2bc-4310-9cf1-de32181ab7e4", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1493000720", "networks": [{"uuid": "9ab078ca-522b-4833-9058-45f147d435ce"}]}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:14:29.298515 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-bca8c053-c8bf-405e-9d16-df0b9e1c7d8b tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:14:29.300072 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-bca8c053-c8bf-405e-9d16-df0b9e1c7d8b tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] [instance: 6fd089f1-5724-405f-8e78-55229c68003e] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:14:29.311591 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-bca8c053-c8bf-405e-9d16-df0b9e1c7d8b tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:29.312464 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-bca8c053-c8bf-405e-9d16-df0b9e1c7d8b tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:29.313868 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-bca8c053-c8bf-405e-9d16-df0b9e1c7d8b tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:29.314662 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-bca8c053-c8bf-405e-9d16-df0b9e1c7d8b tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:29.315940 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.network.neutron [None req-065d7761-d253-4b3c-893c-cd3ff756f83f tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] validate_networks() for [('9ab078ca-522b-4833-9058-45f147d435ce', None, None, None, None, None)] {{(pid=117124) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 04 19:14:29.464376 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-bca8c053-c8bf-405e-9d16-df0b9e1c7d8b tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbc2486d3ef49b79d8422f25b6d0257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c331adb2d6541efbab26b5e11c096be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:14:29.473236 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-bca8c053-c8bf-405e-9d16-df0b9e1c7d8b tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] 10.222.0.69 "GET /compute/v2.1/servers/6fd089f1-5724-405f-8e78-55229c68003e" status: 200 len: 1315 microversion: 2.1 time: 0.181701 May 04 19:14:29.473853 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 482/977] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:14:29 2022] GET /compute/v2.1/servers/6fd089f1-5724-405f-8e78-55229c68003e => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:14:29.715635 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-065d7761-d253-4b3c-893c-cd3ff756f83f tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Flavor limits 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 04 19:14:29.716054 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-065d7761-d253-4b3c-893c-cd3ff756f83f tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Image limits 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 04 19:14:29.716684 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-065d7761-d253-4b3c-893c-cd3ff756f83f tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Flavor pref 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 04 19:14:29.717091 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-065d7761-d253-4b3c-893c-cd3ff756f83f tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Image pref 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 04 19:14:29.717543 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-065d7761-d253-4b3c-893c-cd3ff756f83f tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 04 19:14:29.726098 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-065d7761-d253-4b3c-893c-cd3ff756f83f tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:29.727035 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-065d7761-d253-4b3c-893c-cd3ff756f83f tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:29.727926 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-065d7761-d253-4b3c-893c-cd3ff756f83f tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:29.728355 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-065d7761-d253-4b3c-893c-cd3ff756f83f tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:29.745139 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-065d7761-d253-4b3c-893c-cd3ff756f83f tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Getting quotas for project a92a32956353454db32509526ff751da. Resources: {'cores', 'ram', 'instances'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 04 19:14:29.749394 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-065d7761-d253-4b3c-893c-cd3ff756f83f tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Getting quotas for user 0e0b0f5728f244578741648259bbcd59 and project a92a32956353454db32509526ff751da. Resources: {'cores', 'ram', 'instances'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 04 19:14:29.761297 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-065d7761-d253-4b3c-893c-cd3ff756f83f tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Going to run 1 instances... {{(pid=117124) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 04 19:14:29.763507 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-065d7761-d253-4b3c-893c-cd3ff756f83f tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] [instance: d98e858d-adf1-4fe6-9650-784caa790d1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27aaf5e9-c2bc-4310-9cf1-de32181ab7e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 04 19:14:29.811861 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-065d7761-d253-4b3c-893c-cd3ff756f83f tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.557389 May 04 19:14:29.812512 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 496/978] 10.222.0.69 () {60 vars in 1146 bytes} [Wed May 4 19:14:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 04 19:14:29.824442 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-90b0d4cd-387f-44f8-b4d4-51431d73da0d tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:14:29.825117 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-90b0d4cd-387f-44f8-b4d4-51431d73da0d tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] [instance: d98e858d-adf1-4fe6-9650-784caa790d1a] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:14:29.879790 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-90b0d4cd-387f-44f8-b4d4-51431d73da0d tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b0f5728f244578741648259bbcd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92a32956353454db32509526ff751da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:14:29.887062 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-90b0d4cd-387f-44f8-b4d4-51431d73da0d tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] 10.222.0.69 "GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a" status: 200 len: 1259 microversion: 2.1 time: 0.067472 May 04 19:14:29.887575 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 483/979] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:14:29 2022] GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a => generated 1259 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:14:30.490103 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-26915010-bde0-4dbc-91c9-ae835b105976 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:14:30.490842 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-26915010-bde0-4dbc-91c9-ae835b105976 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] [instance: 6fd089f1-5724-405f-8e78-55229c68003e] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:14:30.498666 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-26915010-bde0-4dbc-91c9-ae835b105976 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:30.499201 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-26915010-bde0-4dbc-91c9-ae835b105976 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:30.500008 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-26915010-bde0-4dbc-91c9-ae835b105976 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:30.500448 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-26915010-bde0-4dbc-91c9-ae835b105976 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:30.634161 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-26915010-bde0-4dbc-91c9-ae835b105976 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbc2486d3ef49b79d8422f25b6d0257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c331adb2d6541efbab26b5e11c096be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:14:30.641859 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-26915010-bde0-4dbc-91c9-ae835b105976 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] 10.222.0.69 "GET /compute/v2.1/servers/6fd089f1-5724-405f-8e78-55229c68003e" status: 200 len: 1465 microversion: 2.1 time: 0.155654 May 04 19:14:30.642425 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 497/980] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:14:30 2022] GET /compute/v2.1/servers/6fd089f1-5724-405f-8e78-55229c68003e => generated 1465 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:14:30.681449 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-2c531b2e-e63e-493a-a8f3-a08315d9f248 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:14:30.682181 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-2c531b2e-e63e-493a-a8f3-a08315d9f248 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] [instance: 6fd089f1-5724-405f-8e78-55229c68003e] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:14:30.688807 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2c531b2e-e63e-493a-a8f3-a08315d9f248 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:30.689255 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2c531b2e-e63e-493a-a8f3-a08315d9f248 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:30.690056 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2c531b2e-e63e-493a-a8f3-a08315d9f248 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:30.690493 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2c531b2e-e63e-493a-a8f3-a08315d9f248 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:30.714225 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-2c531b2e-e63e-493a-a8f3-a08315d9f248 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] [instance: 6fd089f1-5724-405f-8e78-55229c68003e] Going to try to terminate instance {{(pid=117125) delete /opt/stack/nova/nova/compute/api.py:2664}} May 04 19:14:30.789265 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-2c531b2e-e63e-493a-a8f3-a08315d9f248 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] 10.222.0.69 "DELETE /compute/v2.1/servers/6fd089f1-5724-405f-8e78-55229c68003e" status: 204 len: 0 microversion: 2.1 time: 0.112317 May 04 19:14:30.789894 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 484/981] 10.222.0.69 () {58 vars in 1238 bytes} [Wed May 4 19:14:30 2022] DELETE /compute/v2.1/servers/6fd089f1-5724-405f-8e78-55229c68003e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 04 19:14:30.800274 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-8283f96e-3bf8-4354-9d01-c96f8060ea6d tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:14:30.801031 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-8283f96e-3bf8-4354-9d01-c96f8060ea6d tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] [instance: 6fd089f1-5724-405f-8e78-55229c68003e] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:14:30.808825 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8283f96e-3bf8-4354-9d01-c96f8060ea6d tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:30.809281 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8283f96e-3bf8-4354-9d01-c96f8060ea6d tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:30.810156 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8283f96e-3bf8-4354-9d01-c96f8060ea6d tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:30.810596 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8283f96e-3bf8-4354-9d01-c96f8060ea6d tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:30.904926 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-2a327376-186f-40c5-8383-d6791a920d02 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:14:30.905657 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-2a327376-186f-40c5-8383-d6791a920d02 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] [instance: d98e858d-adf1-4fe6-9650-784caa790d1a] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:14:30.911905 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2a327376-186f-40c5-8383-d6791a920d02 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:30.912355 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2a327376-186f-40c5-8383-d6791a920d02 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:30.913120 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2a327376-186f-40c5-8383-d6791a920d02 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:30.914164 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2a327376-186f-40c5-8383-d6791a920d02 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:30.945416 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-8283f96e-3bf8-4354-9d01-c96f8060ea6d tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbc2486d3ef49b79d8422f25b6d0257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c331adb2d6541efbab26b5e11c096be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:14:30.954805 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-8283f96e-3bf8-4354-9d01-c96f8060ea6d tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] 10.222.0.69 "GET /compute/v2.1/servers/6fd089f1-5724-405f-8e78-55229c68003e" status: 200 len: 1471 microversion: 2.1 time: 0.160419 May 04 19:14:30.955402 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 498/982] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:14:30 2022] GET /compute/v2.1/servers/6fd089f1-5724-405f-8e78-55229c68003e => generated 1471 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:14:30.979798 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-2a327376-186f-40c5-8383-d6791a920d02 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b0f5728f244578741648259bbcd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92a32956353454db32509526ff751da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:14:30.987072 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-2a327376-186f-40c5-8383-d6791a920d02 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] 10.222.0.69 "GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a" status: 200 len: 1319 microversion: 2.1 time: 0.086288 May 04 19:14:30.987639 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 485/983] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:14:30 2022] GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a => generated 1319 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:14:31.972455 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-29225b28-bd78-40ca-a26d-b0089405fc7b tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:14:31.973065 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-29225b28-bd78-40ca-a26d-b0089405fc7b tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] [instance: 6fd089f1-5724-405f-8e78-55229c68003e] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:14:31.979955 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-29225b28-bd78-40ca-a26d-b0089405fc7b tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:31.980507 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-29225b28-bd78-40ca-a26d-b0089405fc7b tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:31.981275 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-29225b28-bd78-40ca-a26d-b0089405fc7b tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:31.981738 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-29225b28-bd78-40ca-a26d-b0089405fc7b tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:32.004095 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-2779c0fe-21d1-4220-a295-448ac9e43417 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:14:32.004750 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-2779c0fe-21d1-4220-a295-448ac9e43417 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] [instance: d98e858d-adf1-4fe6-9650-784caa790d1a] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:14:32.011047 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2779c0fe-21d1-4220-a295-448ac9e43417 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:32.011497 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2779c0fe-21d1-4220-a295-448ac9e43417 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:32.012259 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2779c0fe-21d1-4220-a295-448ac9e43417 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:32.012688 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2779c0fe-21d1-4220-a295-448ac9e43417 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:32.082269 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-2779c0fe-21d1-4220-a295-448ac9e43417 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b0f5728f244578741648259bbcd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92a32956353454db32509526ff751da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:14:32.089833 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-2779c0fe-21d1-4220-a295-448ac9e43417 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] 10.222.0.69 "GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a" status: 200 len: 1319 microversion: 2.1 time: 0.089460 May 04 19:14:32.090466 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 486/984] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:14:31 2022] GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a => generated 1319 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:14:32.208959 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-29225b28-bd78-40ca-a26d-b0089405fc7b tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbc2486d3ef49b79d8422f25b6d0257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c331adb2d6541efbab26b5e11c096be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:14:32.217862 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-29225b28-bd78-40ca-a26d-b0089405fc7b tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] 10.222.0.69 "GET /compute/v2.1/servers/6fd089f1-5724-405f-8e78-55229c68003e" status: 200 len: 1471 microversion: 2.1 time: 0.249001 May 04 19:14:32.218453 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 499/985] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:14:31 2022] GET /compute/v2.1/servers/6fd089f1-5724-405f-8e78-55229c68003e => generated 1471 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:14:33.109095 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-ad67c263-23e8-4d4a-8bbd-44f0f2954374 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:14:33.110705 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-ad67c263-23e8-4d4a-8bbd-44f0f2954374 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] [instance: d98e858d-adf1-4fe6-9650-784caa790d1a] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:14:33.125368 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ad67c263-23e8-4d4a-8bbd-44f0f2954374 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:33.127772 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ad67c263-23e8-4d4a-8bbd-44f0f2954374 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:33.131289 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ad67c263-23e8-4d4a-8bbd-44f0f2954374 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:33.133379 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ad67c263-23e8-4d4a-8bbd-44f0f2954374 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:33.235948 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-e36a150b-4301-4643-b314-f24d6fd14e22 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:14:33.236559 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-e36a150b-4301-4643-b314-f24d6fd14e22 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] [instance: 6fd089f1-5724-405f-8e78-55229c68003e] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:14:33.245190 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e36a150b-4301-4643-b314-f24d6fd14e22 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:33.245782 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e36a150b-4301-4643-b314-f24d6fd14e22 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:33.246689 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e36a150b-4301-4643-b314-f24d6fd14e22 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:33.247908 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e36a150b-4301-4643-b314-f24d6fd14e22 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:33.349677 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-ad67c263-23e8-4d4a-8bbd-44f0f2954374 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b0f5728f244578741648259bbcd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92a32956353454db32509526ff751da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:14:33.361516 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-ad67c263-23e8-4d4a-8bbd-44f0f2954374 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] 10.222.0.69 "GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a" status: 200 len: 1359 microversion: 2.1 time: 0.257815 May 04 19:14:33.362749 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 487/986] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:14:33 2022] GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a => generated 1359 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:14:33.635292 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-e36a150b-4301-4643-b314-f24d6fd14e22 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbc2486d3ef49b79d8422f25b6d0257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c331adb2d6541efbab26b5e11c096be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:14:33.650223 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-f606de1c-c97e-458f-8443-97562f0ed2bd req-a44d1092-0741-49d2-805f-22b06221379f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fd089f1-5724-405f-8e78-55229c68003e", "name": "network-vif-deleted", "tag": "f2103973-576f-433f-b089-452e0e426f37"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:14:33.656326 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-e36a150b-4301-4643-b314-f24d6fd14e22 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] 10.222.0.69 "GET /compute/v2.1/servers/6fd089f1-5724-405f-8e78-55229c68003e" status: 200 len: 1429 microversion: 2.1 time: 0.424005 May 04 19:14:33.663960 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-f606de1c-c97e-458f-8443-97562f0ed2bd req-a44d1092-0741-49d2-805f-22b06221379f service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:33.664761 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-f606de1c-c97e-458f-8443-97562f0ed2bd req-a44d1092-0741-49d2-805f-22b06221379f service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:33.682503 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 500/987] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:14:33 2022] GET /compute/v2.1/servers/6fd089f1-5724-405f-8e78-55229c68003e => generated 1429 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:14:33.705258 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-f606de1c-c97e-458f-8443-97562f0ed2bd req-a44d1092-0741-49d2-805f-22b06221379f service nova] Creating event network-vif-deleted:f2103973-576f-433f-b089-452e0e426f37 for instance 6fd089f1-5724-405f-8e78-55229c68003e on hv-cinder-83090 May 04 19:14:33.710984 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-f606de1c-c97e-458f-8443-97562f0ed2bd req-a44d1092-0741-49d2-805f-22b06221379f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064981 May 04 19:14:33.716758 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 488/988] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 04 19:14:34.379938 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-710840c7-1d93-4e81-8d73-457f2b2acb3d tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:14:34.380794 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-710840c7-1d93-4e81-8d73-457f2b2acb3d tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] [instance: d98e858d-adf1-4fe6-9650-784caa790d1a] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:14:34.388642 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-710840c7-1d93-4e81-8d73-457f2b2acb3d tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:34.389374 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-710840c7-1d93-4e81-8d73-457f2b2acb3d tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:34.390369 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-710840c7-1d93-4e81-8d73-457f2b2acb3d tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:34.391233 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-710840c7-1d93-4e81-8d73-457f2b2acb3d tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:34.546248 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-710840c7-1d93-4e81-8d73-457f2b2acb3d tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b0f5728f244578741648259bbcd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92a32956353454db32509526ff751da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:14:34.557621 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-710840c7-1d93-4e81-8d73-457f2b2acb3d tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] 10.222.0.69 "GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a" status: 200 len: 1359 microversion: 2.1 time: 0.181969 May 04 19:14:34.558323 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 501/989] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:14:34 2022] GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a => generated 1359 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:14:34.680021 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-b1f21e7c-c8dd-45b4-8c30-782c431a69ed tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:14:34.681578 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-b1f21e7c-c8dd-45b4-8c30-782c431a69ed tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] [instance: 6fd089f1-5724-405f-8e78-55229c68003e] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:14:34.690412 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b1f21e7c-c8dd-45b4-8c30-782c431a69ed tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:34.691234 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b1f21e7c-c8dd-45b4-8c30-782c431a69ed tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:34.692338 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b1f21e7c-c8dd-45b4-8c30-782c431a69ed tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:34.693027 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b1f21e7c-c8dd-45b4-8c30-782c431a69ed tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:34.759157 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 04 19:14:34.759345 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: Wed May 4 19:14:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6fd089f1-5724-405f-8e78-55229c68003e (ip 10.222.0.69) !!! May 04 19:14:34.766813 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-b1f21e7c-c8dd-45b4-8c30-782c431a69ed tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbc2486d3ef49b79d8422f25b6d0257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c331adb2d6541efbab26b5e11c096be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:14:34.774999 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-b1f21e7c-c8dd-45b4-8c30-782c431a69ed tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] 10.222.0.69 "GET /compute/v2.1/servers/6fd089f1-5724-405f-8e78-55229c68003e" status: 200 len: 1429 microversion: 2.1 time: 0.099924 May 04 19:14:34.787186 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 489/990] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:14:34 2022] GET /compute/v2.1/servers/6fd089f1-5724-405f-8e78-55229c68003e => generated 1429 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:14:35.575933 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-e6b8b045-237c-420a-b158-497a2a39fc63 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:14:35.577292 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-e6b8b045-237c-420a-b158-497a2a39fc63 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] [instance: d98e858d-adf1-4fe6-9650-784caa790d1a] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:14:35.584052 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e6b8b045-237c-420a-b158-497a2a39fc63 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:35.584589 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e6b8b045-237c-420a-b158-497a2a39fc63 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:35.586313 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e6b8b045-237c-420a-b158-497a2a39fc63 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:35.586828 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e6b8b045-237c-420a-b158-497a2a39fc63 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:35.732676 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-e6b8b045-237c-420a-b158-497a2a39fc63 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b0f5728f244578741648259bbcd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92a32956353454db32509526ff751da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:14:35.740263 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-e6b8b045-237c-420a-b158-497a2a39fc63 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] 10.222.0.69 "GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a" status: 200 len: 1359 microversion: 2.1 time: 0.168822 May 04 19:14:35.741057 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 502/991] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:14:35 2022] GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:14:35.793972 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-47895970-440e-4954-a2cd-76e53a620ec3 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:14:35.794602 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-47895970-440e-4954-a2cd-76e53a620ec3 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] [instance: 6fd089f1-5724-405f-8e78-55229c68003e] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:14:35.801103 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-47895970-440e-4954-a2cd-76e53a620ec3 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:35.801850 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-47895970-440e-4954-a2cd-76e53a620ec3 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:35.802849 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-47895970-440e-4954-a2cd-76e53a620ec3 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:35.803484 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-47895970-440e-4954-a2cd-76e53a620ec3 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:35.882546 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-47895970-440e-4954-a2cd-76e53a620ec3 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbc2486d3ef49b79d8422f25b6d0257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c331adb2d6541efbab26b5e11c096be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:14:35.889992 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-47895970-440e-4954-a2cd-76e53a620ec3 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] 10.222.0.69 "GET /compute/v2.1/servers/6fd089f1-5724-405f-8e78-55229c68003e" status: 200 len: 1429 microversion: 2.1 time: 0.100018 May 04 19:14:35.890554 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 490/992] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:14:35 2022] GET /compute/v2.1/servers/6fd089f1-5724-405f-8e78-55229c68003e => generated 1429 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:14:36.758419 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-6618663b-e7e0-49f1-9eae-4414bc7ba036 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:14:36.759016 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-6618663b-e7e0-49f1-9eae-4414bc7ba036 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] [instance: d98e858d-adf1-4fe6-9650-784caa790d1a] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:14:36.765539 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6618663b-e7e0-49f1-9eae-4414bc7ba036 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:36.766221 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6618663b-e7e0-49f1-9eae-4414bc7ba036 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:36.767002 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6618663b-e7e0-49f1-9eae-4414bc7ba036 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:36.767440 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6618663b-e7e0-49f1-9eae-4414bc7ba036 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:36.909319 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-5013abb1-c9e2-4d07-a019-ded4182396d9 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:14:36.909907 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-6618663b-e7e0-49f1-9eae-4414bc7ba036 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b0f5728f244578741648259bbcd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92a32956353454db32509526ff751da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:14:36.910154 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-5013abb1-c9e2-4d07-a019-ded4182396d9 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] [instance: 6fd089f1-5724-405f-8e78-55229c68003e] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:14:36.918996 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-6618663b-e7e0-49f1-9eae-4414bc7ba036 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] 10.222.0.69 "GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a" status: 200 len: 1359 microversion: 2.1 time: 0.164219 May 04 19:14:36.920470 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 503/993] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:14:36 2022] GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:14:36.928930 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5013abb1-c9e2-4d07-a019-ded4182396d9 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:36.930620 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5013abb1-c9e2-4d07-a019-ded4182396d9 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:36.932479 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5013abb1-c9e2-4d07-a019-ded4182396d9 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:36.933132 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5013abb1-c9e2-4d07-a019-ded4182396d9 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:37.019087 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-5013abb1-c9e2-4d07-a019-ded4182396d9 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbc2486d3ef49b79d8422f25b6d0257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c331adb2d6541efbab26b5e11c096be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:14:37.027911 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-5013abb1-c9e2-4d07-a019-ded4182396d9 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] 10.222.0.69 "GET /compute/v2.1/servers/6fd089f1-5724-405f-8e78-55229c68003e" status: 200 len: 1429 microversion: 2.1 time: 0.123038 May 04 19:14:37.029052 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 491/994] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:14:36 2022] GET /compute/v2.1/servers/6fd089f1-5724-405f-8e78-55229c68003e => generated 1429 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:14:37.936785 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-db2791cc-d027-4688-b8a8-d2f9f327a1fb tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:14:37.938303 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-db2791cc-d027-4688-b8a8-d2f9f327a1fb tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] [instance: d98e858d-adf1-4fe6-9650-784caa790d1a] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:14:37.945547 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-db2791cc-d027-4688-b8a8-d2f9f327a1fb tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:37.947825 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-db2791cc-d027-4688-b8a8-d2f9f327a1fb tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:37.948703 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-db2791cc-d027-4688-b8a8-d2f9f327a1fb tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:37.949220 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-db2791cc-d027-4688-b8a8-d2f9f327a1fb tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:38.049683 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-65d4cfe4-da55-46d0-b47c-440466c0f7ea tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:14:38.050297 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-65d4cfe4-da55-46d0-b47c-440466c0f7ea tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] [instance: 6fd089f1-5724-405f-8e78-55229c68003e] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:14:38.057892 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-65d4cfe4-da55-46d0-b47c-440466c0f7ea tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:38.058346 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-65d4cfe4-da55-46d0-b47c-440466c0f7ea tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:38.059118 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-65d4cfe4-da55-46d0-b47c-440466c0f7ea tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:38.059558 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-65d4cfe4-da55-46d0-b47c-440466c0f7ea tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:38.106087 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-db2791cc-d027-4688-b8a8-d2f9f327a1fb tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b0f5728f244578741648259bbcd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92a32956353454db32509526ff751da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:14:38.117929 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-db2791cc-d027-4688-b8a8-d2f9f327a1fb tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] 10.222.0.69 "GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a" status: 200 len: 1359 microversion: 2.1 time: 0.184793 May 04 19:14:38.118932 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 504/995] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:14:37 2022] GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a => generated 1359 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:14:38.152121 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-65d4cfe4-da55-46d0-b47c-440466c0f7ea tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbc2486d3ef49b79d8422f25b6d0257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c331adb2d6541efbab26b5e11c096be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:14:38.168168 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-65d4cfe4-da55-46d0-b47c-440466c0f7ea tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] 10.222.0.69 "GET /compute/v2.1/servers/6fd089f1-5724-405f-8e78-55229c68003e" status: 200 len: 1429 microversion: 2.1 time: 0.122215 May 04 19:14:38.182839 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 492/996] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:14:38 2022] GET /compute/v2.1/servers/6fd089f1-5724-405f-8e78-55229c68003e => generated 1429 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:14:39.136722 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-73046e5b-f962-4894-a68f-4105565cd490 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:14:39.137341 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-73046e5b-f962-4894-a68f-4105565cd490 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] [instance: d98e858d-adf1-4fe6-9650-784caa790d1a] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:14:39.144229 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-73046e5b-f962-4894-a68f-4105565cd490 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:39.144679 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-73046e5b-f962-4894-a68f-4105565cd490 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:39.145452 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-73046e5b-f962-4894-a68f-4105565cd490 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:39.145913 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-73046e5b-f962-4894-a68f-4105565cd490 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:39.194168 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-1f436f38-b7ad-4d86-80d3-07358c2cbd48 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:14:39.194802 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-1f436f38-b7ad-4d86-80d3-07358c2cbd48 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] [instance: 6fd089f1-5724-405f-8e78-55229c68003e] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:14:39.201644 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1f436f38-b7ad-4d86-80d3-07358c2cbd48 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:39.202194 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1f436f38-b7ad-4d86-80d3-07358c2cbd48 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:39.203033 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1f436f38-b7ad-4d86-80d3-07358c2cbd48 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:39.203539 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1f436f38-b7ad-4d86-80d3-07358c2cbd48 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:39.277032 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-1f436f38-b7ad-4d86-80d3-07358c2cbd48 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbc2486d3ef49b79d8422f25b6d0257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c331adb2d6541efbab26b5e11c096be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:14:39.285213 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-1f436f38-b7ad-4d86-80d3-07358c2cbd48 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] 10.222.0.69 "GET /compute/v2.1/servers/6fd089f1-5724-405f-8e78-55229c68003e" status: 200 len: 1429 microversion: 2.1 time: 0.094715 May 04 19:14:39.287073 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 493/997] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:14:39 2022] GET /compute/v2.1/servers/6fd089f1-5724-405f-8e78-55229c68003e => generated 1429 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:14:39.321910 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-73046e5b-f962-4894-a68f-4105565cd490 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b0f5728f244578741648259bbcd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92a32956353454db32509526ff751da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:14:39.329215 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-73046e5b-f962-4894-a68f-4105565cd490 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] 10.222.0.69 "GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a" status: 200 len: 1359 microversion: 2.1 time: 0.196993 May 04 19:14:39.330088 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 505/998] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:14:39 2022] GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a => generated 1359 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:14:40.306225 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-84873085-4b0d-46bd-b46a-b30426e9f087 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:14:40.306853 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-84873085-4b0d-46bd-b46a-b30426e9f087 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] [instance: 6fd089f1-5724-405f-8e78-55229c68003e] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:14:40.313197 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-84873085-4b0d-46bd-b46a-b30426e9f087 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:40.313754 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-84873085-4b0d-46bd-b46a-b30426e9f087 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:40.314531 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-84873085-4b0d-46bd-b46a-b30426e9f087 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:40.314974 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-84873085-4b0d-46bd-b46a-b30426e9f087 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:40.346126 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-2cc45da7-6ff7-4de7-9495-4e53285452ec tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:14:40.346820 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-2cc45da7-6ff7-4de7-9495-4e53285452ec tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] [instance: d98e858d-adf1-4fe6-9650-784caa790d1a] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:14:40.353828 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2cc45da7-6ff7-4de7-9495-4e53285452ec tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:40.354364 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2cc45da7-6ff7-4de7-9495-4e53285452ec tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:40.355247 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2cc45da7-6ff7-4de7-9495-4e53285452ec tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:40.355717 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2cc45da7-6ff7-4de7-9495-4e53285452ec tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:40.379231 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-84873085-4b0d-46bd-b46a-b30426e9f087 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbc2486d3ef49b79d8422f25b6d0257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c331adb2d6541efbab26b5e11c096be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:14:40.391823 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-84873085-4b0d-46bd-b46a-b30426e9f087 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] 10.222.0.69 "GET /compute/v2.1/servers/6fd089f1-5724-405f-8e78-55229c68003e" status: 200 len: 1429 microversion: 2.1 time: 0.089396 May 04 19:14:40.393555 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 494/999] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:14:40 2022] GET /compute/v2.1/servers/6fd089f1-5724-405f-8e78-55229c68003e => generated 1429 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:14:40.516446 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-2cc45da7-6ff7-4de7-9495-4e53285452ec tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b0f5728f244578741648259bbcd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92a32956353454db32509526ff751da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:14:40.525001 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-2cc45da7-6ff7-4de7-9495-4e53285452ec tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] 10.222.0.69 "GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a" status: 200 len: 1359 microversion: 2.1 time: 0.182400 May 04 19:14:40.525705 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 506/1000] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:14:40 2022] GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a => generated 1359 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:14:41.410111 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-c8ef928b-659e-4664-8c1c-94b349f842ef tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:14:41.410853 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-c8ef928b-659e-4664-8c1c-94b349f842ef tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] [instance: 6fd089f1-5724-405f-8e78-55229c68003e] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:14:41.417447 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c8ef928b-659e-4664-8c1c-94b349f842ef tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:41.417922 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c8ef928b-659e-4664-8c1c-94b349f842ef tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:41.418678 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c8ef928b-659e-4664-8c1c-94b349f842ef tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:41.419110 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c8ef928b-659e-4664-8c1c-94b349f842ef tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:41.543237 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-0eb726b1-b266-4788-b0a5-0efab3ff867e tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:14:41.543926 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-0eb726b1-b266-4788-b0a5-0efab3ff867e tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] [instance: d98e858d-adf1-4fe6-9650-784caa790d1a] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:14:41.550949 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0eb726b1-b266-4788-b0a5-0efab3ff867e tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:41.551427 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0eb726b1-b266-4788-b0a5-0efab3ff867e tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:41.552240 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0eb726b1-b266-4788-b0a5-0efab3ff867e tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:41.553014 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0eb726b1-b266-4788-b0a5-0efab3ff867e tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:41.641935 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-c8ef928b-659e-4664-8c1c-94b349f842ef tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbc2486d3ef49b79d8422f25b6d0257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c331adb2d6541efbab26b5e11c096be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:14:41.649342 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-c8ef928b-659e-4664-8c1c-94b349f842ef tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] 10.222.0.69 "GET /compute/v2.1/servers/6fd089f1-5724-405f-8e78-55229c68003e" status: 200 len: 1429 microversion: 2.1 time: 0.243006 May 04 19:14:41.649941 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 495/1001] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:14:41 2022] GET /compute/v2.1/servers/6fd089f1-5724-405f-8e78-55229c68003e => generated 1429 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:14:41.687366 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-0eb726b1-b266-4788-b0a5-0efab3ff867e tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b0f5728f244578741648259bbcd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92a32956353454db32509526ff751da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:14:41.694721 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-0eb726b1-b266-4788-b0a5-0efab3ff867e tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] 10.222.0.69 "GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a" status: 200 len: 1359 microversion: 2.1 time: 0.156268 May 04 19:14:41.695273 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 507/1002] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:14:41 2022] GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:14:42.666032 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-1b33738e-07ae-46d4-a136-677c95249f56 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:14:42.666644 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-1b33738e-07ae-46d4-a136-677c95249f56 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] [instance: 6fd089f1-5724-405f-8e78-55229c68003e] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:14:42.672923 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1b33738e-07ae-46d4-a136-677c95249f56 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:42.673375 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1b33738e-07ae-46d4-a136-677c95249f56 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:42.674205 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1b33738e-07ae-46d4-a136-677c95249f56 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:42.674648 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1b33738e-07ae-46d4-a136-677c95249f56 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:42.711616 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-c4dbe7cc-b0c4-4d93-aea9-b619bdbb4d80 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:14:42.713066 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-c4dbe7cc-b0c4-4d93-aea9-b619bdbb4d80 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] [instance: d98e858d-adf1-4fe6-9650-784caa790d1a] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:14:42.718364 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1b33738e-07ae-46d4-a136-677c95249f56 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:42.718986 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1b33738e-07ae-46d4-a136-677c95249f56 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:42.719733 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.objects.instance [None req-1b33738e-07ae-46d4-a136-677c95249f56 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lazy-loading 'fault' on Instance uuid 6fd089f1-5724-405f-8e78-55229c68003e {{(pid=117125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 04 19:14:42.721954 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c4dbe7cc-b0c4-4d93-aea9-b619bdbb4d80 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:42.722648 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c4dbe7cc-b0c4-4d93-aea9-b619bdbb4d80 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:42.723631 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c4dbe7cc-b0c4-4d93-aea9-b619bdbb4d80 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:42.724198 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c4dbe7cc-b0c4-4d93-aea9-b619bdbb4d80 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:42.777559 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-1b33738e-07ae-46d4-a136-677c95249f56 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbc2486d3ef49b79d8422f25b6d0257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c331adb2d6541efbab26b5e11c096be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:14:42.787017 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-1b33738e-07ae-46d4-a136-677c95249f56 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] 10.222.0.69 "GET /compute/v2.1/servers/6fd089f1-5724-405f-8e78-55229c68003e" status: 200 len: 1305 microversion: 2.1 time: 0.124663 May 04 19:14:42.787980 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 496/1003] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:14:42 2022] GET /compute/v2.1/servers/6fd089f1-5724-405f-8e78-55229c68003e => generated 1305 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:14:42.932649 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-c4dbe7cc-b0c4-4d93-aea9-b619bdbb4d80 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b0f5728f244578741648259bbcd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92a32956353454db32509526ff751da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:14:42.940108 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-c4dbe7cc-b0c4-4d93-aea9-b619bdbb4d80 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] 10.222.0.69 "GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a" status: 200 len: 1359 microversion: 2.1 time: 0.232542 May 04 19:14:42.940665 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 508/1004] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:14:42 2022] GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a => generated 1359 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:14:43.016923 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-bc0c178a-1c7d-43ca-9f69-81654da17160 req-6172ef56-bc1e-4372-93cc-e2a2ebd26e34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d98e858d-adf1-4fe6-9650-784caa790d1a", "tag": "9e010276-d5b3-4d5f-821f-294d451cebe7"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:14:43.028704 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-bc0c178a-1c7d-43ca-9f69-81654da17160 req-6172ef56-bc1e-4372-93cc-e2a2ebd26e34 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:43.029828 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-bc0c178a-1c7d-43ca-9f69-81654da17160 req-6172ef56-bc1e-4372-93cc-e2a2ebd26e34 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:43.046674 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-bc0c178a-1c7d-43ca-9f69-81654da17160 req-6172ef56-bc1e-4372-93cc-e2a2ebd26e34 service nova] Creating event network-changed:9e010276-d5b3-4d5f-821f-294d451cebe7 for instance d98e858d-adf1-4fe6-9650-784caa790d1a on hv-cinder-83090 May 04 19:14:43.065993 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-bc0c178a-1c7d-43ca-9f69-81654da17160 req-6172ef56-bc1e-4372-93cc-e2a2ebd26e34 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051795 May 04 19:14:43.067363 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 497/1005] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:14:43.804263 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-8c43121f-5acc-4a7d-ae83-c694f2cfd084 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:14:43.804912 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-8c43121f-5acc-4a7d-ae83-c694f2cfd084 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] [instance: 6fd089f1-5724-405f-8e78-55229c68003e] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:14:43.811290 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8c43121f-5acc-4a7d-ae83-c694f2cfd084 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:43.811739 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8c43121f-5acc-4a7d-ae83-c694f2cfd084 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:43.812495 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8c43121f-5acc-4a7d-ae83-c694f2cfd084 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:43.812931 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8c43121f-5acc-4a7d-ae83-c694f2cfd084 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:43.826993 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.wsgi [None req-8c43121f-5acc-4a7d-ae83-c694f2cfd084 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] HTTP exception thrown: Instance 6fd089f1-5724-405f-8e78-55229c68003e could not be found. May 04 19:14:43.827589 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-8c43121f-5acc-4a7d-ae83-c694f2cfd084 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] Returning 404 to user: Instance 6fd089f1-5724-405f-8e78-55229c68003e could not be found. {{(pid=117124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 04 19:14:43.828404 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-8c43121f-5acc-4a7d-ae83-c694f2cfd084 tempest-VolumesNegativeTest-366666440 tempest-VolumesNegativeTest-366666440-project] 10.222.0.69 "GET /compute/v2.1/servers/6fd089f1-5724-405f-8e78-55229c68003e" status: 404 len: 111 microversion: 2.1 time: 0.028129 May 04 19:14:43.832077 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 509/1006] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:14:43 2022] GET /compute/v2.1/servers/6fd089f1-5724-405f-8e78-55229c68003e => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 04 19:14:43.964021 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-07d26646-3158-4a08-986f-18260d6aced4 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:14:43.965053 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-07d26646-3158-4a08-986f-18260d6aced4 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] [instance: d98e858d-adf1-4fe6-9650-784caa790d1a] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:14:43.973656 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-07d26646-3158-4a08-986f-18260d6aced4 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:43.974346 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-07d26646-3158-4a08-986f-18260d6aced4 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:43.975186 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-07d26646-3158-4a08-986f-18260d6aced4 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:43.975658 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-07d26646-3158-4a08-986f-18260d6aced4 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:44.123509 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-07d26646-3158-4a08-986f-18260d6aced4 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b0f5728f244578741648259bbcd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92a32956353454db32509526ff751da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:14:44.132316 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-07d26646-3158-4a08-986f-18260d6aced4 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] 10.222.0.69 "GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a" status: 200 len: 1359 microversion: 2.1 time: 0.178023 May 04 19:14:44.132891 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 498/1007] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:14:43 2022] GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:14:45.150305 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-6ee1a1a1-102e-4858-983c-25ecdc5aa05f tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:14:45.151128 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-6ee1a1a1-102e-4858-983c-25ecdc5aa05f tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] [instance: d98e858d-adf1-4fe6-9650-784caa790d1a] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:14:45.159580 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6ee1a1a1-102e-4858-983c-25ecdc5aa05f tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:45.160097 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6ee1a1a1-102e-4858-983c-25ecdc5aa05f tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:45.160907 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6ee1a1a1-102e-4858-983c-25ecdc5aa05f tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:45.161343 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6ee1a1a1-102e-4858-983c-25ecdc5aa05f tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:45.385967 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-6ee1a1a1-102e-4858-983c-25ecdc5aa05f tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b0f5728f244578741648259bbcd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92a32956353454db32509526ff751da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:14:45.395537 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-6ee1a1a1-102e-4858-983c-25ecdc5aa05f tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] 10.222.0.69 "GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a" status: 200 len: 1359 microversion: 2.1 time: 0.249977 May 04 19:14:45.396104 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 510/1008] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:14:45 2022] GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a => generated 1359 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:14:46.412207 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-7220351e-6f17-475f-b9f3-f9a6f316440d tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:14:46.412823 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-7220351e-6f17-475f-b9f3-f9a6f316440d tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] [instance: d98e858d-adf1-4fe6-9650-784caa790d1a] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:14:46.419935 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7220351e-6f17-475f-b9f3-f9a6f316440d tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:46.420385 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7220351e-6f17-475f-b9f3-f9a6f316440d tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:46.421147 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7220351e-6f17-475f-b9f3-f9a6f316440d tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:46.421611 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7220351e-6f17-475f-b9f3-f9a6f316440d tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:46.549154 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-7220351e-6f17-475f-b9f3-f9a6f316440d tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b0f5728f244578741648259bbcd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92a32956353454db32509526ff751da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:14:46.556281 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-7220351e-6f17-475f-b9f3-f9a6f316440d tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] 10.222.0.69 "GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a" status: 200 len: 1359 microversion: 2.1 time: 0.148055 May 04 19:14:46.556891 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 499/1009] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:14:46 2022] GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:14:47.524235 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-060cc9e1-05a5-4bac-bcad-557427834ff7 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-218381965", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-97506937", "security_groups": [{"name": "tempest-secgroup-smoke-258690831"}], "networks": [{"uuid": "0b2c1eea-9230-4bef-b6ed-3d1855510315"}], "block_device_mapping_v2": [{"uuid": "7e2d0268-2faf-4e57-9b45-248aff30d7a9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:14:47.574592 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-f0896019-02a9-4f29-808a-5f386ff24a1b tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:14:47.575347 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-f0896019-02a9-4f29-808a-5f386ff24a1b tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] [instance: d98e858d-adf1-4fe6-9650-784caa790d1a] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:14:47.582166 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f0896019-02a9-4f29-808a-5f386ff24a1b tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:47.582617 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f0896019-02a9-4f29-808a-5f386ff24a1b tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:47.583580 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f0896019-02a9-4f29-808a-5f386ff24a1b tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:47.584021 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f0896019-02a9-4f29-808a-5f386ff24a1b tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:47.678063 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.network.neutron [None req-060cc9e1-05a5-4bac-bcad-557427834ff7 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] validate_networks() for [('0b2c1eea-9230-4bef-b6ed-3d1855510315', None, None, None, None, None)] {{(pid=117124) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 04 19:14:47.778669 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-f0896019-02a9-4f29-808a-5f386ff24a1b tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b0f5728f244578741648259bbcd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92a32956353454db32509526ff751da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:14:47.792499 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-f0896019-02a9-4f29-808a-5f386ff24a1b tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] 10.222.0.69 "GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a" status: 200 len: 1359 microversion: 2.1 time: 0.222740 May 04 19:14:47.793080 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 500/1010] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:14:47 2022] GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a => generated 1359 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:14:47.797765 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-05d9d4c6-7772-4573-a64e-47e57fac8e6b req-e9812e04-9d93-4a9a-a799-9801b753341e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d98e858d-adf1-4fe6-9650-784caa790d1a", "name": "network-vif-plugged", "status": "completed", "tag": "9e010276-d5b3-4d5f-821f-294d451cebe7"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:14:47.805989 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-05d9d4c6-7772-4573-a64e-47e57fac8e6b req-e9812e04-9d93-4a9a-a799-9801b753341e service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:47.806437 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-05d9d4c6-7772-4573-a64e-47e57fac8e6b req-e9812e04-9d93-4a9a-a799-9801b753341e service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:47.819136 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-05d9d4c6-7772-4573-a64e-47e57fac8e6b req-e9812e04-9d93-4a9a-a799-9801b753341e service nova] Creating event network-vif-plugged:9e010276-d5b3-4d5f-821f-294d451cebe7 for instance d98e858d-adf1-4fe6-9650-784caa790d1a on hv-cinder-83090 May 04 19:14:47.824123 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-05d9d4c6-7772-4573-a64e-47e57fac8e6b req-e9812e04-9d93-4a9a-a799-9801b753341e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029692 May 04 19:14:47.824719 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 501/1011] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:14:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:14:48.180928 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-060cc9e1-05a5-4bac-bcad-557427834ff7 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Flavor limits 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 04 19:14:48.181374 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-060cc9e1-05a5-4bac-bcad-557427834ff7 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Image limits 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 04 19:14:48.182011 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-060cc9e1-05a5-4bac-bcad-557427834ff7 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Flavor pref 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 04 19:14:48.182431 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-060cc9e1-05a5-4bac-bcad-557427834ff7 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Image pref 0:0:0 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 04 19:14:48.182853 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.virt.hardware [None req-060cc9e1-05a5-4bac-bcad-557427834ff7 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 04 19:14:48.192329 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-060cc9e1-05a5-4bac-bcad-557427834ff7 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:48.192781 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-060cc9e1-05a5-4bac-bcad-557427834ff7 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:48.193622 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-060cc9e1-05a5-4bac-bcad-557427834ff7 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:48.194598 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-060cc9e1-05a5-4bac-bcad-557427834ff7 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:48.212491 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-060cc9e1-05a5-4bac-bcad-557427834ff7 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Getting quotas for project cc0c73a5efc84e348363ae368873f51d. Resources: {'cores', 'ram', 'instances'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 04 19:14:48.216813 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.quota [None req-060cc9e1-05a5-4bac-bcad-557427834ff7 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Getting quotas for user 1fa0cd8ed723418daf1cbd6933e0ce6b and project cc0c73a5efc84e348363ae368873f51d. Resources: {'cores', 'ram', 'instances'} {{(pid=117124) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 04 19:14:48.276979 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-060cc9e1-05a5-4bac-bcad-557427834ff7 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Going to run 1 instances... {{(pid=117124) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 04 19:14:48.279055 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-060cc9e1-05a5-4bac-bcad-557427834ff7 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] [instance: 92be652a-42d2-4b99-9dd4-c50102203b92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7e2d0268-2faf-4e57-9b45-248aff30d7a9',volume_size=None,volume_type=None)] {{(pid=117124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 04 19:14:48.414395 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-060cc9e1-05a5-4bac-bcad-557427834ff7 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.894447 May 04 19:14:48.415034 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 511/1012] 10.222.0.69 () {60 vars in 1146 bytes} [Wed May 4 19:14:47 2022] POST /compute/v2.1/servers => generated 405 bytes in 896 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 04 19:14:48.425404 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-923c7b76-d021-4325-83b3-822a8003a4d0 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:14:48.426081 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-923c7b76-d021-4325-83b3-822a8003a4d0 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] [instance: 92be652a-42d2-4b99-9dd4-c50102203b92] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:14:48.484639 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-923c7b76-d021-4325-83b3-822a8003a4d0 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa0cd8ed723418daf1cbd6933e0ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0c73a5efc84e348363ae368873f51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:14:48.493279 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-923c7b76-d021-4325-83b3-822a8003a4d0 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] 10.222.0.69 "GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92" status: 200 len: 1086 microversion: 2.1 time: 0.071807 May 04 19:14:48.493969 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 502/1013] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:14:48 2022] GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92 => generated 1086 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:14:48.810345 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-d1861449-aa58-4d36-8409-366cbcde5b22 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:14:48.811191 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-d1861449-aa58-4d36-8409-366cbcde5b22 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] [instance: d98e858d-adf1-4fe6-9650-784caa790d1a] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:14:48.818080 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d1861449-aa58-4d36-8409-366cbcde5b22 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:48.818541 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d1861449-aa58-4d36-8409-366cbcde5b22 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:48.819854 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d1861449-aa58-4d36-8409-366cbcde5b22 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:48.820293 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d1861449-aa58-4d36-8409-366cbcde5b22 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:48.953441 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-d1861449-aa58-4d36-8409-366cbcde5b22 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b0f5728f244578741648259bbcd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92a32956353454db32509526ff751da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:14:48.960774 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-d1861449-aa58-4d36-8409-366cbcde5b22 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] 10.222.0.69 "GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a" status: 200 len: 1359 microversion: 2.1 time: 0.155406 May 04 19:14:48.961330 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 512/1014] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:14:48 2022] GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:14:49.510434 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-cf777d28-0633-4675-afb0-75aa1e1a26a3 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:14:49.511036 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-cf777d28-0633-4675-afb0-75aa1e1a26a3 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] [instance: 92be652a-42d2-4b99-9dd4-c50102203b92] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:14:49.517849 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cf777d28-0633-4675-afb0-75aa1e1a26a3 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:49.518297 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cf777d28-0633-4675-afb0-75aa1e1a26a3 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:49.519055 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cf777d28-0633-4675-afb0-75aa1e1a26a3 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:49.519503 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cf777d28-0633-4675-afb0-75aa1e1a26a3 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:49.578405 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-cf777d28-0633-4675-afb0-75aa1e1a26a3 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa0cd8ed723418daf1cbd6933e0ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0c73a5efc84e348363ae368873f51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:14:49.586059 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-cf777d28-0633-4675-afb0-75aa1e1a26a3 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] 10.222.0.69 "GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92" status: 200 len: 1184 microversion: 2.1 time: 0.079474 May 04 19:14:49.586618 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 503/1015] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:14:49 2022] GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92 => generated 1184 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:14:49.982853 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-49ee214d-ce23-45f9-ac35-ab9f8482a281 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:14:49.983581 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-49ee214d-ce23-45f9-ac35-ab9f8482a281 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] [instance: d98e858d-adf1-4fe6-9650-784caa790d1a] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:14:49.990167 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-49ee214d-ce23-45f9-ac35-ab9f8482a281 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:49.990629 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-49ee214d-ce23-45f9-ac35-ab9f8482a281 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:49.992087 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-49ee214d-ce23-45f9-ac35-ab9f8482a281 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:49.992521 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-49ee214d-ce23-45f9-ac35-ab9f8482a281 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:50.119631 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-49ee214d-ce23-45f9-ac35-ab9f8482a281 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b0f5728f244578741648259bbcd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92a32956353454db32509526ff751da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:14:50.126777 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-49ee214d-ce23-45f9-ac35-ab9f8482a281 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] 10.222.0.69 "GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a" status: 200 len: 1359 microversion: 2.1 time: 0.150006 May 04 19:14:50.127341 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 513/1016] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:14:49 2022] GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:14:50.603189 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-c1e7569a-e305-4a03-a885-93c25e8def2d tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:14:50.603797 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-c1e7569a-e305-4a03-a885-93c25e8def2d tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] [instance: 92be652a-42d2-4b99-9dd4-c50102203b92] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:14:50.610140 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c1e7569a-e305-4a03-a885-93c25e8def2d tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:50.610591 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c1e7569a-e305-4a03-a885-93c25e8def2d tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:50.611347 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c1e7569a-e305-4a03-a885-93c25e8def2d tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:50.611787 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c1e7569a-e305-4a03-a885-93c25e8def2d tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:50.671260 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-c1e7569a-e305-4a03-a885-93c25e8def2d tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa0cd8ed723418daf1cbd6933e0ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0c73a5efc84e348363ae368873f51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:14:50.678433 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-c1e7569a-e305-4a03-a885-93c25e8def2d tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] 10.222.0.69 "GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92" status: 200 len: 1184 microversion: 2.1 time: 0.079043 May 04 19:14:50.678994 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 504/1017] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:14:50 2022] GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92 => generated 1184 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:14:51.143754 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-9ad570b6-dd7c-413a-a0e3-2006090330e2 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:14:51.144366 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-9ad570b6-dd7c-413a-a0e3-2006090330e2 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] [instance: d98e858d-adf1-4fe6-9650-784caa790d1a] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:14:51.150872 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9ad570b6-dd7c-413a-a0e3-2006090330e2 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:51.151321 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9ad570b6-dd7c-413a-a0e3-2006090330e2 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:51.152081 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9ad570b6-dd7c-413a-a0e3-2006090330e2 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:51.152541 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9ad570b6-dd7c-413a-a0e3-2006090330e2 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:51.277406 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-9ad570b6-dd7c-413a-a0e3-2006090330e2 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b0f5728f244578741648259bbcd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92a32956353454db32509526ff751da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:14:51.284592 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-9ad570b6-dd7c-413a-a0e3-2006090330e2 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] 10.222.0.69 "GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a" status: 200 len: 1359 microversion: 2.1 time: 0.144986 May 04 19:14:51.285144 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 514/1018] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:14:51 2022] GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a => generated 1359 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:14:51.695193 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-7b844252-b203-4b6c-a4e2-94e235bdd14f tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:14:51.695800 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-7b844252-b203-4b6c-a4e2-94e235bdd14f tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] [instance: 92be652a-42d2-4b99-9dd4-c50102203b92] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:14:51.702239 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7b844252-b203-4b6c-a4e2-94e235bdd14f tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:51.702692 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7b844252-b203-4b6c-a4e2-94e235bdd14f tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:51.703489 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7b844252-b203-4b6c-a4e2-94e235bdd14f tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:51.703929 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7b844252-b203-4b6c-a4e2-94e235bdd14f tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:51.763555 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-7b844252-b203-4b6c-a4e2-94e235bdd14f tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa0cd8ed723418daf1cbd6933e0ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0c73a5efc84e348363ae368873f51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:14:51.771029 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-7b844252-b203-4b6c-a4e2-94e235bdd14f tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] 10.222.0.69 "GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92" status: 200 len: 1184 microversion: 2.1 time: 0.079765 May 04 19:14:51.771587 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 505/1019] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:14:51 2022] GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92 => generated 1184 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:14:52.302044 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-89abafd0-6974-4cfc-8fa1-b8a58e35729e tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:14:52.302703 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-89abafd0-6974-4cfc-8fa1-b8a58e35729e tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] [instance: d98e858d-adf1-4fe6-9650-784caa790d1a] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:14:52.309586 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-89abafd0-6974-4cfc-8fa1-b8a58e35729e tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:52.310036 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-89abafd0-6974-4cfc-8fa1-b8a58e35729e tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:52.310798 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-89abafd0-6974-4cfc-8fa1-b8a58e35729e tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:52.311235 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-89abafd0-6974-4cfc-8fa1-b8a58e35729e tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:52.497676 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-89abafd0-6974-4cfc-8fa1-b8a58e35729e tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b0f5728f244578741648259bbcd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92a32956353454db32509526ff751da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:14:52.505151 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-89abafd0-6974-4cfc-8fa1-b8a58e35729e tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] 10.222.0.69 "GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a" status: 200 len: 1549 microversion: 2.1 time: 0.207033 May 04 19:14:52.505785 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 515/1020] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:14:52 2022] GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a => generated 1549 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:14:52.521402 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-0329375f-99aa-46ca-adea-404d3e6b8354 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:14:52.522627 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-0329375f-99aa-46ca-adea-404d3e6b8354 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] [instance: d98e858d-adf1-4fe6-9650-784caa790d1a] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:14:52.528534 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0329375f-99aa-46ca-adea-404d3e6b8354 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:52.528984 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0329375f-99aa-46ca-adea-404d3e6b8354 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:52.529953 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0329375f-99aa-46ca-adea-404d3e6b8354 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:52.530545 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0329375f-99aa-46ca-adea-404d3e6b8354 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:52.664411 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-0329375f-99aa-46ca-adea-404d3e6b8354 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b0f5728f244578741648259bbcd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92a32956353454db32509526ff751da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:14:52.673800 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-0329375f-99aa-46ca-adea-404d3e6b8354 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] 10.222.0.69 "GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a" status: 200 len: 1549 microversion: 2.1 time: 0.156011 May 04 19:14:52.674375 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 506/1021] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:14:52 2022] GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a => generated 1549 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:14:52.689645 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-c717e0a8-46f0-456d-9e08-96b75c2bc6d2 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:14:52.693081 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-c717e0a8-46f0-456d-9e08-96b75c2bc6d2 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0e0b0f5728f244578741648259bbcd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92a32956353454db32509526ff751da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:14:52.694371 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-c717e0a8-46f0-456d-9e08-96b75c2bc6d2 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Searching by: {'deleted': False, 'project_id': 'a92a32956353454db32509526ff751da'} {{(pid=117124) get_all /opt/stack/nova/nova/compute/api.py:2960}} May 04 19:14:52.700832 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c717e0a8-46f0-456d-9e08-96b75c2bc6d2 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:52.701307 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c717e0a8-46f0-456d-9e08-96b75c2bc6d2 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:52.702303 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c717e0a8-46f0-456d-9e08-96b75c2bc6d2 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:52.702743 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c717e0a8-46f0-456d-9e08-96b75c2bc6d2 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:52.788535 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-bee01533-c026-4936-b7e9-f8d1dbebdc0d tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:14:52.789516 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-bee01533-c026-4936-b7e9-f8d1dbebdc0d tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] [instance: 92be652a-42d2-4b99-9dd4-c50102203b92] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:14:52.794675 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.multi_cell_list [None req-c717e0a8-46f0-456d-9e08-96b75c2bc6d2 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117124) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 04 19:14:52.797603 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-bee01533-c026-4936-b7e9-f8d1dbebdc0d tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:52.798172 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-bee01533-c026-4936-b7e9-f8d1dbebdc0d tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:52.799063 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-bee01533-c026-4936-b7e9-f8d1dbebdc0d tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:52.799732 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-bee01533-c026-4936-b7e9-f8d1dbebdc0d tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:52.866909 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-bee01533-c026-4936-b7e9-f8d1dbebdc0d tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa0cd8ed723418daf1cbd6933e0ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0c73a5efc84e348363ae368873f51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:14:52.874583 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-bee01533-c026-4936-b7e9-f8d1dbebdc0d tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] 10.222.0.69 "GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92" status: 200 len: 1202 microversion: 2.1 time: 0.090371 May 04 19:14:52.875376 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 507/1022] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:14:52 2022] GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92 => generated 1202 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:14:52.901234 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-c717e0a8-46f0-456d-9e08-96b75c2bc6d2 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] 10.222.0.69 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.215477 May 04 19:14:52.901957 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 516/1023] 10.222.0.69 () {58 vars in 1124 bytes} [Wed May 4 19:14:52 2022] GET /compute/v2.1/servers => generated 343 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:14:52.912180 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-34aaa929-ea54-42da-9469-969c306a3095 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:14:52.913207 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-34aaa929-ea54-42da-9469-969c306a3095 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] [instance: d98e858d-adf1-4fe6-9650-784caa790d1a] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:14:52.919285 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-34aaa929-ea54-42da-9469-969c306a3095 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:52.919729 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-34aaa929-ea54-42da-9469-969c306a3095 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:52.920489 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-34aaa929-ea54-42da-9469-969c306a3095 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:52.920920 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-34aaa929-ea54-42da-9469-969c306a3095 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:53.056846 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-34aaa929-ea54-42da-9469-969c306a3095 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b0f5728f244578741648259bbcd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92a32956353454db32509526ff751da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:14:53.064106 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-34aaa929-ea54-42da-9469-969c306a3095 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] 10.222.0.69 "GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a" status: 200 len: 1549 microversion: 2.1 time: 0.155652 May 04 19:14:53.064724 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 508/1024] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:14:52 2022] GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a => generated 1549 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:14:53.858331 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-3c61412d-6746-4489-992c-d764aadc7417 req-7a15f166-b4cf-4bce-aaeb-e44d49d1c256 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92be652a-42d2-4b99-9dd4-c50102203b92", "tag": "ed81644c-0d75-4430-8134-757799f98502"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:14:53.867261 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-3c61412d-6746-4489-992c-d764aadc7417 req-7a15f166-b4cf-4bce-aaeb-e44d49d1c256 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:53.867673 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-3c61412d-6746-4489-992c-d764aadc7417 req-7a15f166-b4cf-4bce-aaeb-e44d49d1c256 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:53.895175 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-3c61412d-6746-4489-992c-d764aadc7417 req-7a15f166-b4cf-4bce-aaeb-e44d49d1c256 service nova] Creating event network-changed:ed81644c-0d75-4430-8134-757799f98502 for instance 92be652a-42d2-4b99-9dd4-c50102203b92 on hv-cinder-83090 May 04 19:14:53.895427 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-4a168cf5-d8d4-43bb-a404-68349fa8ee7c tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:14:53.895427 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-4a168cf5-d8d4-43bb-a404-68349fa8ee7c tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] [instance: 92be652a-42d2-4b99-9dd4-c50102203b92] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:14:53.902006 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4a168cf5-d8d4-43bb-a404-68349fa8ee7c tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:53.903276 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-3c61412d-6746-4489-992c-d764aadc7417 req-7a15f166-b4cf-4bce-aaeb-e44d49d1c256 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045565 May 04 19:14:53.903999 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 517/1025] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:14:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:14:53.904256 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4a168cf5-d8d4-43bb-a404-68349fa8ee7c tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:53.905399 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4a168cf5-d8d4-43bb-a404-68349fa8ee7c tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:53.906451 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-4a168cf5-d8d4-43bb-a404-68349fa8ee7c tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:54.098780 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-4a168cf5-d8d4-43bb-a404-68349fa8ee7c tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa0cd8ed723418daf1cbd6933e0ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0c73a5efc84e348363ae368873f51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:14:54.108739 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-4a168cf5-d8d4-43bb-a404-68349fa8ee7c tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] 10.222.0.69 "GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92" status: 200 len: 1269 microversion: 2.1 time: 0.220545 May 04 19:14:54.109830 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 509/1026] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:14:53 2022] GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92 => generated 1269 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:14:54.598805 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-8d82682b-4802-416b-8ccc-b13ba0dcbd9e tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "616469fe-6cd5-494a-894d-d51d71572dc2"}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:14:54.600568 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-8d82682b-4802-416b-8ccc-b13ba0dcbd9e tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] [instance: d98e858d-adf1-4fe6-9650-784caa790d1a] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:14:54.606756 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8d82682b-4802-416b-8ccc-b13ba0dcbd9e tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:54.607157 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8d82682b-4802-416b-8ccc-b13ba0dcbd9e tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:54.607918 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8d82682b-4802-416b-8ccc-b13ba0dcbd9e tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:54.608353 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8d82682b-4802-416b-8ccc-b13ba0dcbd9e tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:54.951762 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-8d82682b-4802-416b-8ccc-b13ba0dcbd9e tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] 10.222.0.69 "POST /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.357116 May 04 19:14:54.952554 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 518/1027] 10.222.0.69 () {60 vars in 1322 bytes} [Wed May 4 19:14:54 2022] POST /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a/os-volume_attachments => generated 194 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:14:55.125844 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-c88fd361-c4b4-455f-918f-12a94e795572 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:14:55.126696 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-c88fd361-c4b4-455f-918f-12a94e795572 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] [instance: 92be652a-42d2-4b99-9dd4-c50102203b92] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:14:55.133005 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c88fd361-c4b4-455f-918f-12a94e795572 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:55.133551 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c88fd361-c4b4-455f-918f-12a94e795572 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:55.134391 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c88fd361-c4b4-455f-918f-12a94e795572 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:55.134913 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c88fd361-c4b4-455f-918f-12a94e795572 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:55.264126 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-c88fd361-c4b4-455f-918f-12a94e795572 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa0cd8ed723418daf1cbd6933e0ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0c73a5efc84e348363ae368873f51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:14:55.271722 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-c88fd361-c4b4-455f-918f-12a94e795572 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] 10.222.0.69 "GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92" status: 200 len: 1257 microversion: 2.1 time: 0.149744 May 04 19:14:55.273514 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 510/1028] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:14:55 2022] GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92 => generated 1257 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:14:56.292497 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-af4e1cae-9caf-4534-842d-26615e18d487 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:14:56.293142 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-af4e1cae-9caf-4534-842d-26615e18d487 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] [instance: 92be652a-42d2-4b99-9dd4-c50102203b92] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:14:56.299284 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-af4e1cae-9caf-4534-842d-26615e18d487 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:56.299732 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-af4e1cae-9caf-4534-842d-26615e18d487 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:56.300496 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-af4e1cae-9caf-4534-842d-26615e18d487 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:56.300931 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-af4e1cae-9caf-4534-842d-26615e18d487 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:56.439577 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-af4e1cae-9caf-4534-842d-26615e18d487 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa0cd8ed723418daf1cbd6933e0ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0c73a5efc84e348363ae368873f51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:14:56.448493 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-af4e1cae-9caf-4534-842d-26615e18d487 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] 10.222.0.69 "GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92" status: 200 len: 1257 microversion: 2.1 time: 0.160692 May 04 19:14:56.449071 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 519/1029] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:14:56 2022] GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92 => generated 1257 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:14:57.467862 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-0a95fecb-8980-4fb8-a7ba-a9f517c7ca12 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:14:57.468508 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-0a95fecb-8980-4fb8-a7ba-a9f517c7ca12 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] [instance: 92be652a-42d2-4b99-9dd4-c50102203b92] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:14:57.474810 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0a95fecb-8980-4fb8-a7ba-a9f517c7ca12 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:57.475258 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0a95fecb-8980-4fb8-a7ba-a9f517c7ca12 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:57.476022 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0a95fecb-8980-4fb8-a7ba-a9f517c7ca12 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:57.476466 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0a95fecb-8980-4fb8-a7ba-a9f517c7ca12 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:57.601041 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-0a95fecb-8980-4fb8-a7ba-a9f517c7ca12 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa0cd8ed723418daf1cbd6933e0ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0c73a5efc84e348363ae368873f51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:14:57.608231 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-0a95fecb-8980-4fb8-a7ba-a9f517c7ca12 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] 10.222.0.69 "GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92" status: 200 len: 1257 microversion: 2.1 time: 0.144345 May 04 19:14:57.608794 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 511/1030] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:14:57 2022] GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92 => generated 1257 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:14:58.625512 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-babc4f3b-fe9f-4d66-932a-08da23d49224 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:14:58.626111 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-babc4f3b-fe9f-4d66-932a-08da23d49224 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] [instance: 92be652a-42d2-4b99-9dd4-c50102203b92] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:14:58.633001 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-babc4f3b-fe9f-4d66-932a-08da23d49224 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:58.633452 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-babc4f3b-fe9f-4d66-932a-08da23d49224 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:58.634224 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-babc4f3b-fe9f-4d66-932a-08da23d49224 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:58.634664 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-babc4f3b-fe9f-4d66-932a-08da23d49224 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:58.776414 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-babc4f3b-fe9f-4d66-932a-08da23d49224 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa0cd8ed723418daf1cbd6933e0ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0c73a5efc84e348363ae368873f51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:14:58.786792 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-babc4f3b-fe9f-4d66-932a-08da23d49224 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] 10.222.0.69 "GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92" status: 200 len: 1257 microversion: 2.1 time: 0.164799 May 04 19:14:58.787819 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 520/1031] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:14:58 2022] GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92 => generated 1257 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:14:59.806416 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-96ab04bf-6e3c-4b74-84b6-ff7ec84b8acf tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:14:59.807030 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-96ab04bf-6e3c-4b74-84b6-ff7ec84b8acf tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] [instance: 92be652a-42d2-4b99-9dd4-c50102203b92] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:14:59.813303 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-96ab04bf-6e3c-4b74-84b6-ff7ec84b8acf tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:59.813782 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-96ab04bf-6e3c-4b74-84b6-ff7ec84b8acf tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:59.814543 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-96ab04bf-6e3c-4b74-84b6-ff7ec84b8acf tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:14:59.814984 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-96ab04bf-6e3c-4b74-84b6-ff7ec84b8acf tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:14:59.948190 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-96ab04bf-6e3c-4b74-84b6-ff7ec84b8acf tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa0cd8ed723418daf1cbd6933e0ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0c73a5efc84e348363ae368873f51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:14:59.955549 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-96ab04bf-6e3c-4b74-84b6-ff7ec84b8acf tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] 10.222.0.69 "GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92" status: 200 len: 1257 microversion: 2.1 time: 0.152947 May 04 19:14:59.956119 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 512/1032] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:14:59 2022] GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92 => generated 1257 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:15:00.971996 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-d0e0414b-9c22-4b01-8312-bdf721146023 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:15:00.972602 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-d0e0414b-9c22-4b01-8312-bdf721146023 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] [instance: 92be652a-42d2-4b99-9dd4-c50102203b92] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:15:00.979630 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d0e0414b-9c22-4b01-8312-bdf721146023 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:15:00.980076 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d0e0414b-9c22-4b01-8312-bdf721146023 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:15:00.980836 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d0e0414b-9c22-4b01-8312-bdf721146023 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:15:00.981266 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d0e0414b-9c22-4b01-8312-bdf721146023 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:15:01.120091 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-d0e0414b-9c22-4b01-8312-bdf721146023 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa0cd8ed723418daf1cbd6933e0ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0c73a5efc84e348363ae368873f51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:15:01.127444 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-d0e0414b-9c22-4b01-8312-bdf721146023 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] 10.222.0.69 "GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92" status: 200 len: 1257 microversion: 2.1 time: 0.159259 May 04 19:15:01.128000 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 521/1033] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:15:00 2022] GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92 => generated 1257 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:15:02.145127 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-dc5fed24-512a-4183-a263-529f05d227a0 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:15:02.145691 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-dc5fed24-512a-4183-a263-529f05d227a0 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] [instance: 92be652a-42d2-4b99-9dd4-c50102203b92] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:15:02.152394 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-dc5fed24-512a-4183-a263-529f05d227a0 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:15:02.152843 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-dc5fed24-512a-4183-a263-529f05d227a0 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:15:02.153804 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-dc5fed24-512a-4183-a263-529f05d227a0 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:15:02.154242 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-dc5fed24-512a-4183-a263-529f05d227a0 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:15:02.296161 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-dc5fed24-512a-4183-a263-529f05d227a0 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa0cd8ed723418daf1cbd6933e0ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0c73a5efc84e348363ae368873f51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:15:02.304867 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-dc5fed24-512a-4183-a263-529f05d227a0 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] 10.222.0.69 "GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92" status: 200 len: 1257 microversion: 2.1 time: 0.164653 May 04 19:15:02.305444 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 513/1034] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:15:02 2022] GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92 => generated 1257 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:15:02.481602 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-f5d6ac04-394a-483e-85db-ae92f4ab4ac3 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:15:02.482215 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-f5d6ac04-394a-483e-85db-ae92f4ab4ac3 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] [instance: d98e858d-adf1-4fe6-9650-784caa790d1a] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:15:02.488468 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f5d6ac04-394a-483e-85db-ae92f4ab4ac3 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:15:02.488916 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f5d6ac04-394a-483e-85db-ae92f4ab4ac3 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:15:02.489709 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f5d6ac04-394a-483e-85db-ae92f4ab4ac3 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:15:02.490148 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-f5d6ac04-394a-483e-85db-ae92f4ab4ac3 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:15:02.621526 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-f5d6ac04-394a-483e-85db-ae92f4ab4ac3 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b0f5728f244578741648259bbcd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92a32956353454db32509526ff751da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:15:02.629255 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-f5d6ac04-394a-483e-85db-ae92f4ab4ac3 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] 10.222.0.69 "GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a" status: 200 len: 1595 microversion: 2.1 time: 0.151528 May 04 19:15:02.629910 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 522/1035] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:15:02 2022] GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a => generated 1595 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:15:03.321794 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-3ffc0dcc-4fd3-4103-a3ea-6241d82fb4b2 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:15:03.322408 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-3ffc0dcc-4fd3-4103-a3ea-6241d82fb4b2 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] [instance: 92be652a-42d2-4b99-9dd4-c50102203b92] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:15:03.328971 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3ffc0dcc-4fd3-4103-a3ea-6241d82fb4b2 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:15:03.329648 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3ffc0dcc-4fd3-4103-a3ea-6241d82fb4b2 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:15:03.330532 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3ffc0dcc-4fd3-4103-a3ea-6241d82fb4b2 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:15:03.331086 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-3ffc0dcc-4fd3-4103-a3ea-6241d82fb4b2 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:15:03.471198 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-3ffc0dcc-4fd3-4103-a3ea-6241d82fb4b2 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa0cd8ed723418daf1cbd6933e0ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0c73a5efc84e348363ae368873f51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:15:03.479021 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-3ffc0dcc-4fd3-4103-a3ea-6241d82fb4b2 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] 10.222.0.69 "GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92" status: 200 len: 1257 microversion: 2.1 time: 0.161428 May 04 19:15:03.479740 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 514/1036] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:15:03 2022] GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92 => generated 1257 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:15:03.753222 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-799885ba-2077-4ce0-84ea-f217e4220f34 req-562cb545-b9f9-459b-a066-acf6ecfd67cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92be652a-42d2-4b99-9dd4-c50102203b92", "name": "network-vif-plugged", "status": "completed", "tag": "ed81644c-0d75-4430-8134-757799f98502"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:15:03.763015 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-799885ba-2077-4ce0-84ea-f217e4220f34 req-562cb545-b9f9-459b-a066-acf6ecfd67cd service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:15:03.763475 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-799885ba-2077-4ce0-84ea-f217e4220f34 req-562cb545-b9f9-459b-a066-acf6ecfd67cd service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:15:03.775960 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-799885ba-2077-4ce0-84ea-f217e4220f34 req-562cb545-b9f9-459b-a066-acf6ecfd67cd service nova] Creating event network-vif-plugged:ed81644c-0d75-4430-8134-757799f98502 for instance 92be652a-42d2-4b99-9dd4-c50102203b92 on hv-cinder-83090 May 04 19:15:03.781075 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-799885ba-2077-4ce0-84ea-f217e4220f34 req-562cb545-b9f9-459b-a066-acf6ecfd67cd service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031895 May 04 19:15:03.781833 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 523/1037] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:15:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:15:04.495888 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-b06bd9c9-36cf-4588-8941-ba63517e41a3 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:15:04.496494 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-b06bd9c9-36cf-4588-8941-ba63517e41a3 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] [instance: 92be652a-42d2-4b99-9dd4-c50102203b92] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:15:04.503333 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b06bd9c9-36cf-4588-8941-ba63517e41a3 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:15:04.503771 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b06bd9c9-36cf-4588-8941-ba63517e41a3 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:15:04.504538 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b06bd9c9-36cf-4588-8941-ba63517e41a3 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:15:04.505603 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b06bd9c9-36cf-4588-8941-ba63517e41a3 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:15:04.649392 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-b06bd9c9-36cf-4588-8941-ba63517e41a3 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa0cd8ed723418daf1cbd6933e0ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0c73a5efc84e348363ae368873f51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:15:04.657330 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-b06bd9c9-36cf-4588-8941-ba63517e41a3 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] 10.222.0.69 "GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92" status: 200 len: 1257 microversion: 2.1 time: 0.165241 May 04 19:15:04.658188 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 515/1038] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:15:04 2022] GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92 => generated 1257 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:15:04.732155 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-062d793b-8d6d-4ad6-83cb-c2017f3a811d req-e72e4a83-c510-4ee6-ba9e-302082bdd958 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d98e858d-adf1-4fe6-9650-784caa790d1a", "tag": "9e010276-d5b3-4d5f-821f-294d451cebe7"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:15:04.743427 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-062d793b-8d6d-4ad6-83cb-c2017f3a811d req-e72e4a83-c510-4ee6-ba9e-302082bdd958 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:15:04.743861 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-062d793b-8d6d-4ad6-83cb-c2017f3a811d req-e72e4a83-c510-4ee6-ba9e-302082bdd958 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:15:04.757280 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-062d793b-8d6d-4ad6-83cb-c2017f3a811d req-e72e4a83-c510-4ee6-ba9e-302082bdd958 service nova] Creating event network-changed:9e010276-d5b3-4d5f-821f-294d451cebe7 for instance d98e858d-adf1-4fe6-9650-784caa790d1a on hv-cinder-83090 May 04 19:15:04.763920 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-062d793b-8d6d-4ad6-83cb-c2017f3a811d req-e72e4a83-c510-4ee6-ba9e-302082bdd958 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036077 May 04 19:15:04.764880 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 524/1039] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 04 19:15:05.674581 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-263912de-c8f7-4b47-af45-1381231a35a1 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:15:05.675841 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-263912de-c8f7-4b47-af45-1381231a35a1 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] [instance: 92be652a-42d2-4b99-9dd4-c50102203b92] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:15:05.688999 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-263912de-c8f7-4b47-af45-1381231a35a1 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:15:05.689304 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-263912de-c8f7-4b47-af45-1381231a35a1 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:15:05.690259 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-263912de-c8f7-4b47-af45-1381231a35a1 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:15:05.690792 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-263912de-c8f7-4b47-af45-1381231a35a1 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:15:05.924104 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-263912de-c8f7-4b47-af45-1381231a35a1 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa0cd8ed723418daf1cbd6933e0ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0c73a5efc84e348363ae368873f51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:15:05.933061 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-263912de-c8f7-4b47-af45-1381231a35a1 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] 10.222.0.69 "GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92" status: 200 len: 1257 microversion: 2.1 time: 0.262376 May 04 19:15:05.944722 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 516/1040] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:15:05 2022] GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92 => generated 1257 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:15:06.116634 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-1bf63a3a-3115-4567-b321-f91188823b90 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-199764966"}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:15:06.117307 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-1bf63a3a-3115-4567-b321-f91188823b90 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] [instance: d98e858d-adf1-4fe6-9650-784caa790d1a] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:15:06.123658 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1bf63a3a-3115-4567-b321-f91188823b90 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:15:06.124223 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1bf63a3a-3115-4567-b321-f91188823b90 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:15:06.125344 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1bf63a3a-3115-4567-b321-f91188823b90 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:15:06.125685 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-1bf63a3a-3115-4567-b321-f91188823b90 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:15:06.320860 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.network.security_group_api [None req-1bf63a3a-3115-4567-b321-f91188823b90 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Adding security group 705a8451-8d57-4208-ba1d-a40eb04dd688 to port 9e010276-d5b3-4d5f-821f-294d451cebe7 May 04 19:15:06.697399 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-1bf63a3a-3115-4567-b321-f91188823b90 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] 10.222.0.69 "POST /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a/action" status: 202 len: 0 microversion: 2.1 time: 0.585711 May 04 19:15:06.698247 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 525/1041] 10.222.0.69 () {60 vars in 1277 bytes} [Wed May 4 19:15:06 2022] POST /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a/action => generated 0 bytes in 588 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 04 19:15:06.706438 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-cf96c0ac-e17b-42b1-9bbd-8e5a74dd2f06 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:15:06.707048 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-cf96c0ac-e17b-42b1-9bbd-8e5a74dd2f06 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] [instance: d98e858d-adf1-4fe6-9650-784caa790d1a] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:15:06.715471 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cf96c0ac-e17b-42b1-9bbd-8e5a74dd2f06 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:15:06.715885 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cf96c0ac-e17b-42b1-9bbd-8e5a74dd2f06 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:15:06.717137 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cf96c0ac-e17b-42b1-9bbd-8e5a74dd2f06 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:15:06.717924 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cf96c0ac-e17b-42b1-9bbd-8e5a74dd2f06 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:15:06.786415 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-336ef950-363c-42b9-8328-1a8df19b99a2 req-2a43cb85-1af7-4071-a1fa-8b605a53c331 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d98e858d-adf1-4fe6-9650-784caa790d1a", "tag": "9e010276-d5b3-4d5f-821f-294d451cebe7"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:15:06.798068 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-336ef950-363c-42b9-8328-1a8df19b99a2 req-2a43cb85-1af7-4071-a1fa-8b605a53c331 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:15:06.798770 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-336ef950-363c-42b9-8328-1a8df19b99a2 req-2a43cb85-1af7-4071-a1fa-8b605a53c331 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:15:06.821971 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-336ef950-363c-42b9-8328-1a8df19b99a2 req-2a43cb85-1af7-4071-a1fa-8b605a53c331 service nova] Creating event network-changed:9e010276-d5b3-4d5f-821f-294d451cebe7 for instance d98e858d-adf1-4fe6-9650-784caa790d1a on hv-cinder-83090 May 04 19:15:06.829496 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-336ef950-363c-42b9-8328-1a8df19b99a2 req-2a43cb85-1af7-4071-a1fa-8b605a53c331 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046926 May 04 19:15:06.830799 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 526/1042] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:15:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 04 19:15:06.913410 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-cf96c0ac-e17b-42b1-9bbd-8e5a74dd2f06 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b0f5728f244578741648259bbcd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92a32956353454db32509526ff751da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:15:06.927169 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-cf96c0ac-e17b-42b1-9bbd-8e5a74dd2f06 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] 10.222.0.69 "GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a" status: 200 len: 1759 microversion: 2.1 time: 0.224432 May 04 19:15:06.928311 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 517/1043] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:15:06 2022] GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a => generated 1759 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:15:06.950745 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-bebf26fe-a2b4-4e47-ac77-90d99131f8f7 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:15:06.951477 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-bebf26fe-a2b4-4e47-ac77-90d99131f8f7 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] [instance: 92be652a-42d2-4b99-9dd4-c50102203b92] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:15:06.959763 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-bebf26fe-a2b4-4e47-ac77-90d99131f8f7 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:15:06.960420 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-bebf26fe-a2b4-4e47-ac77-90d99131f8f7 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:15:06.961505 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-bebf26fe-a2b4-4e47-ac77-90d99131f8f7 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:15:06.962137 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-bebf26fe-a2b4-4e47-ac77-90d99131f8f7 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:15:07.188860 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-bebf26fe-a2b4-4e47-ac77-90d99131f8f7 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa0cd8ed723418daf1cbd6933e0ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0c73a5efc84e348363ae368873f51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:15:07.203234 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-bebf26fe-a2b4-4e47-ac77-90d99131f8f7 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] 10.222.0.69 "GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92" status: 200 len: 1441 microversion: 2.1 time: 0.255203 May 04 19:15:07.203886 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 527/1044] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:15:06 2022] GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92 => generated 1441 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:15:07.220019 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-771d62a6-0e40-460b-8ef7-880320a04950 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:15:07.220895 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-771d62a6-0e40-460b-8ef7-880320a04950 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] [instance: 92be652a-42d2-4b99-9dd4-c50102203b92] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:15:07.227244 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-771d62a6-0e40-460b-8ef7-880320a04950 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:15:07.227956 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-771d62a6-0e40-460b-8ef7-880320a04950 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:15:07.228670 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-771d62a6-0e40-460b-8ef7-880320a04950 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:15:07.229111 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-771d62a6-0e40-460b-8ef7-880320a04950 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:15:07.372100 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-771d62a6-0e40-460b-8ef7-880320a04950 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa0cd8ed723418daf1cbd6933e0ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0c73a5efc84e348363ae368873f51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:15:07.379488 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-771d62a6-0e40-460b-8ef7-880320a04950 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] 10.222.0.69 "GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92" status: 200 len: 1441 microversion: 2.1 time: 0.163377 May 04 19:15:07.380687 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 518/1045] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:15:07 2022] GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92 => generated 1441 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:15:09.445552 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-dcbc930b-300f-46c2-a133-42088667d01b req-05a08034-a757-406f-8ef4-f7cced7a8da7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92be652a-42d2-4b99-9dd4-c50102203b92", "tag": "ed81644c-0d75-4430-8134-757799f98502"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:15:09.454375 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-dcbc930b-300f-46c2-a133-42088667d01b req-05a08034-a757-406f-8ef4-f7cced7a8da7 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:15:09.454875 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-dcbc930b-300f-46c2-a133-42088667d01b req-05a08034-a757-406f-8ef4-f7cced7a8da7 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:15:09.466688 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-dcbc930b-300f-46c2-a133-42088667d01b req-05a08034-a757-406f-8ef4-f7cced7a8da7 service nova] Creating event network-changed:ed81644c-0d75-4430-8134-757799f98502 for instance 92be652a-42d2-4b99-9dd4-c50102203b92 on hv-cinder-83090 May 04 19:15:09.471996 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-dcbc930b-300f-46c2-a133-42088667d01b req-05a08034-a757-406f-8ef4-f7cced7a8da7 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030459 May 04 19:15:09.472669 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 528/1046] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:15:35.917883 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-b9db5ca4-083b-4afa-88de-1dbd71605682 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:15:35.918919 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-b9db5ca4-083b-4afa-88de-1dbd71605682 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] [instance: d98e858d-adf1-4fe6-9650-784caa790d1a] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:15:35.924790 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b9db5ca4-083b-4afa-88de-1dbd71605682 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:15:35.925240 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b9db5ca4-083b-4afa-88de-1dbd71605682 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:15:35.926030 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b9db5ca4-083b-4afa-88de-1dbd71605682 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:15:35.926479 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b9db5ca4-083b-4afa-88de-1dbd71605682 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:15:35.997219 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-b9db5ca4-083b-4afa-88de-1dbd71605682 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] 10.222.0.69 "POST /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a/action" status: 202 len: 0 microversion: 2.1 time: 0.083856 May 04 19:15:35.997889 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 519/1047] 10.222.0.69 () {60 vars in 1277 bytes} [Wed May 4 19:15:35 2022] POST /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 04 19:15:36.006507 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-91abcd1e-143c-4a10-b00d-d37c230d42e9 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:15:36.007489 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-91abcd1e-143c-4a10-b00d-d37c230d42e9 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] [instance: d98e858d-adf1-4fe6-9650-784caa790d1a] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:15:36.016660 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-91abcd1e-143c-4a10-b00d-d37c230d42e9 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:15:36.017302 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-91abcd1e-143c-4a10-b00d-d37c230d42e9 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:15:36.018107 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-91abcd1e-143c-4a10-b00d-d37c230d42e9 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:15:36.023125 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-91abcd1e-143c-4a10-b00d-d37c230d42e9 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:15:36.253324 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-91abcd1e-143c-4a10-b00d-d37c230d42e9 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b0f5728f244578741648259bbcd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92a32956353454db32509526ff751da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:15:36.261712 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-91abcd1e-143c-4a10-b00d-d37c230d42e9 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] 10.222.0.69 "GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a" status: 200 len: 1751 microversion: 2.1 time: 0.259526 May 04 19:15:36.262297 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 529/1048] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:15:36 2022] GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a => generated 1751 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:15:37.280427 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-977b63c9-9d2f-49da-88a1-4f1c646a34ba tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:15:37.281045 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-977b63c9-9d2f-49da-88a1-4f1c646a34ba tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] [instance: d98e858d-adf1-4fe6-9650-784caa790d1a] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:15:37.287259 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-977b63c9-9d2f-49da-88a1-4f1c646a34ba tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:15:37.287704 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-977b63c9-9d2f-49da-88a1-4f1c646a34ba tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:15:37.289147 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-977b63c9-9d2f-49da-88a1-4f1c646a34ba tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:15:37.289613 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-977b63c9-9d2f-49da-88a1-4f1c646a34ba tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:15:37.431591 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-977b63c9-9d2f-49da-88a1-4f1c646a34ba tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b0f5728f244578741648259bbcd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92a32956353454db32509526ff751da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:15:37.439523 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-977b63c9-9d2f-49da-88a1-4f1c646a34ba tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] 10.222.0.69 "GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a" status: 200 len: 1756 microversion: 2.1 time: 0.163822 May 04 19:15:37.440090 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 520/1049] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:15:37 2022] GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:15:38.456336 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-62ca3914-016a-4059-bc41-d7edd131da39 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:15:38.456943 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-62ca3914-016a-4059-bc41-d7edd131da39 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] [instance: d98e858d-adf1-4fe6-9650-784caa790d1a] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:15:38.463354 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-62ca3914-016a-4059-bc41-d7edd131da39 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:15:38.463802 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-62ca3914-016a-4059-bc41-d7edd131da39 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:15:38.464556 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-62ca3914-016a-4059-bc41-d7edd131da39 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:15:38.464987 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-62ca3914-016a-4059-bc41-d7edd131da39 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:15:38.609047 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-62ca3914-016a-4059-bc41-d7edd131da39 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b0f5728f244578741648259bbcd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92a32956353454db32509526ff751da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:15:38.617569 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-62ca3914-016a-4059-bc41-d7edd131da39 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] 10.222.0.69 "GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a" status: 200 len: 1756 microversion: 2.1 time: 0.165079 May 04 19:15:38.618136 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 530/1050] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:15:38 2022] GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:15:39.635166 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-da61096d-0e27-4ca2-915e-4a0063f19a0b tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:15:39.635771 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-da61096d-0e27-4ca2-915e-4a0063f19a0b tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] [instance: d98e858d-adf1-4fe6-9650-784caa790d1a] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:15:39.642484 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-da61096d-0e27-4ca2-915e-4a0063f19a0b tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:15:39.643057 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-da61096d-0e27-4ca2-915e-4a0063f19a0b tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:15:39.644005 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-da61096d-0e27-4ca2-915e-4a0063f19a0b tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:15:39.644463 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-da61096d-0e27-4ca2-915e-4a0063f19a0b tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:15:39.787542 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-da61096d-0e27-4ca2-915e-4a0063f19a0b tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b0f5728f244578741648259bbcd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92a32956353454db32509526ff751da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:15:39.795203 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-da61096d-0e27-4ca2-915e-4a0063f19a0b tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] 10.222.0.69 "GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a" status: 200 len: 1756 microversion: 2.1 time: 0.164553 May 04 19:15:39.795756 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 521/1051] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:15:39 2022] GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:15:40.812761 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-7d329f82-0db1-4921-92c6-82a2506665e1 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:15:40.813377 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-7d329f82-0db1-4921-92c6-82a2506665e1 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] [instance: d98e858d-adf1-4fe6-9650-784caa790d1a] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:15:40.819807 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7d329f82-0db1-4921-92c6-82a2506665e1 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:15:40.820251 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7d329f82-0db1-4921-92c6-82a2506665e1 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:15:40.821019 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7d329f82-0db1-4921-92c6-82a2506665e1 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:15:40.821453 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7d329f82-0db1-4921-92c6-82a2506665e1 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:15:40.957056 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-7d329f82-0db1-4921-92c6-82a2506665e1 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b0f5728f244578741648259bbcd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92a32956353454db32509526ff751da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:15:40.965517 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-7d329f82-0db1-4921-92c6-82a2506665e1 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] 10.222.0.69 "GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a" status: 200 len: 1756 microversion: 2.1 time: 0.156562 May 04 19:15:40.966186 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 531/1052] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:15:40 2022] GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a => generated 1756 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:15:41.982324 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-b04c0599-045d-4525-9bbd-36531976cef5 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:15:41.983016 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-b04c0599-045d-4525-9bbd-36531976cef5 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] [instance: d98e858d-adf1-4fe6-9650-784caa790d1a] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:15:41.989532 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b04c0599-045d-4525-9bbd-36531976cef5 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:15:41.989980 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b04c0599-045d-4525-9bbd-36531976cef5 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:15:41.991232 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b04c0599-045d-4525-9bbd-36531976cef5 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:15:41.991669 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-b04c0599-045d-4525-9bbd-36531976cef5 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:15:42.131282 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-b04c0599-045d-4525-9bbd-36531976cef5 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b0f5728f244578741648259bbcd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92a32956353454db32509526ff751da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:15:42.139365 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-b04c0599-045d-4525-9bbd-36531976cef5 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] 10.222.0.69 "GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a" status: 200 len: 1756 microversion: 2.1 time: 0.160864 May 04 19:15:42.139929 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 522/1053] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:15:41 2022] GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:15:43.156519 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-2866a54a-536e-4810-906f-641e3868a0e9 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:15:43.157161 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-2866a54a-536e-4810-906f-641e3868a0e9 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] [instance: d98e858d-adf1-4fe6-9650-784caa790d1a] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:15:43.163896 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2866a54a-536e-4810-906f-641e3868a0e9 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:15:43.164340 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2866a54a-536e-4810-906f-641e3868a0e9 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:15:43.165090 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2866a54a-536e-4810-906f-641e3868a0e9 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:15:43.165549 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2866a54a-536e-4810-906f-641e3868a0e9 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:15:43.302947 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-2866a54a-536e-4810-906f-641e3868a0e9 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b0f5728f244578741648259bbcd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92a32956353454db32509526ff751da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:15:43.310887 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-2866a54a-536e-4810-906f-641e3868a0e9 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] 10.222.0.69 "GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a" status: 200 len: 1756 microversion: 2.1 time: 0.158209 May 04 19:15:43.311451 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 532/1054] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:15:43 2022] GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a => generated 1756 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:15:44.328501 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-894e7843-b7cc-4661-8452-d91a8e6befcb tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:15:44.329107 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-894e7843-b7cc-4661-8452-d91a8e6befcb tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] [instance: d98e858d-adf1-4fe6-9650-784caa790d1a] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:15:44.335139 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-894e7843-b7cc-4661-8452-d91a8e6befcb tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:15:44.335581 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-894e7843-b7cc-4661-8452-d91a8e6befcb tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:15:44.336359 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-894e7843-b7cc-4661-8452-d91a8e6befcb tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:15:44.336789 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-894e7843-b7cc-4661-8452-d91a8e6befcb tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:15:44.477454 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-894e7843-b7cc-4661-8452-d91a8e6befcb tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b0f5728f244578741648259bbcd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92a32956353454db32509526ff751da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:15:44.485205 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-894e7843-b7cc-4661-8452-d91a8e6befcb tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] 10.222.0.69 "GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a" status: 200 len: 1756 microversion: 2.1 time: 0.160540 May 04 19:15:44.485817 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 523/1055] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:15:44 2022] GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:15:45.503052 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-2d6dcd96-1254-4a2a-a9c1-31db9bf80ab0 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:15:45.503594 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-2d6dcd96-1254-4a2a-a9c1-31db9bf80ab0 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] [instance: d98e858d-adf1-4fe6-9650-784caa790d1a] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:15:45.510498 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2d6dcd96-1254-4a2a-a9c1-31db9bf80ab0 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:15:45.510947 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2d6dcd96-1254-4a2a-a9c1-31db9bf80ab0 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:15:45.511710 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2d6dcd96-1254-4a2a-a9c1-31db9bf80ab0 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:15:45.512150 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2d6dcd96-1254-4a2a-a9c1-31db9bf80ab0 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:15:45.653574 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-2d6dcd96-1254-4a2a-a9c1-31db9bf80ab0 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b0f5728f244578741648259bbcd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92a32956353454db32509526ff751da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:15:45.661253 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-2d6dcd96-1254-4a2a-a9c1-31db9bf80ab0 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] 10.222.0.69 "GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a" status: 200 len: 1756 microversion: 2.1 time: 0.162194 May 04 19:15:45.662029 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 533/1056] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:15:45 2022] GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:15:46.677844 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-5b2fb933-1194-40d8-97a2-f3baddbb5d8a tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:15:46.678435 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-5b2fb933-1194-40d8-97a2-f3baddbb5d8a tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] [instance: d98e858d-adf1-4fe6-9650-784caa790d1a] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:15:46.685226 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5b2fb933-1194-40d8-97a2-f3baddbb5d8a tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:15:46.685713 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5b2fb933-1194-40d8-97a2-f3baddbb5d8a tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:15:46.686478 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5b2fb933-1194-40d8-97a2-f3baddbb5d8a tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:15:46.686915 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5b2fb933-1194-40d8-97a2-f3baddbb5d8a tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:15:46.825502 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-5b2fb933-1194-40d8-97a2-f3baddbb5d8a tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b0f5728f244578741648259bbcd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92a32956353454db32509526ff751da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:15:46.833164 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-5b2fb933-1194-40d8-97a2-f3baddbb5d8a tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] 10.222.0.69 "GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a" status: 200 len: 1756 microversion: 2.1 time: 0.159261 May 04 19:15:46.833768 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 524/1057] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:15:46 2022] GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a => generated 1756 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:15:47.850202 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-01dbd2f3-ec14-49b6-a4a6-883914b5157e tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:15:47.850812 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-01dbd2f3-ec14-49b6-a4a6-883914b5157e tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] [instance: d98e858d-adf1-4fe6-9650-784caa790d1a] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:15:47.857687 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-01dbd2f3-ec14-49b6-a4a6-883914b5157e tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:15:47.858134 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-01dbd2f3-ec14-49b6-a4a6-883914b5157e tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:15:47.858891 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-01dbd2f3-ec14-49b6-a4a6-883914b5157e tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:15:47.859326 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-01dbd2f3-ec14-49b6-a4a6-883914b5157e tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:15:47.994950 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-01dbd2f3-ec14-49b6-a4a6-883914b5157e tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b0f5728f244578741648259bbcd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92a32956353454db32509526ff751da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:15:48.002654 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-01dbd2f3-ec14-49b6-a4a6-883914b5157e tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] 10.222.0.69 "GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a" status: 200 len: 1756 microversion: 2.1 time: 0.156340 May 04 19:15:48.003214 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 534/1058] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:15:47 2022] GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a => generated 1756 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:15:49.019912 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-c70939b5-f923-43fe-b4eb-25c54a23560c tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:15:49.020518 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-c70939b5-f923-43fe-b4eb-25c54a23560c tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] [instance: d98e858d-adf1-4fe6-9650-784caa790d1a] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:15:49.027999 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c70939b5-f923-43fe-b4eb-25c54a23560c tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:15:49.028454 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c70939b5-f923-43fe-b4eb-25c54a23560c tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:15:49.029226 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c70939b5-f923-43fe-b4eb-25c54a23560c tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:15:49.029706 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-c70939b5-f923-43fe-b4eb-25c54a23560c tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:15:49.170973 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-c70939b5-f923-43fe-b4eb-25c54a23560c tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b0f5728f244578741648259bbcd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92a32956353454db32509526ff751da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:15:49.178754 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-c70939b5-f923-43fe-b4eb-25c54a23560c tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] 10.222.0.69 "GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a" status: 200 len: 1756 microversion: 2.1 time: 0.162972 May 04 19:15:49.179794 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 525/1059] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:15:49 2022] GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:15:50.196786 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-647f12c7-c2b7-4833-bc3e-a4872eb64147 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:15:50.197341 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-647f12c7-c2b7-4833-bc3e-a4872eb64147 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] [instance: d98e858d-adf1-4fe6-9650-784caa790d1a] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:15:50.203970 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-647f12c7-c2b7-4833-bc3e-a4872eb64147 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:15:50.204421 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-647f12c7-c2b7-4833-bc3e-a4872eb64147 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:15:50.205204 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-647f12c7-c2b7-4833-bc3e-a4872eb64147 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:15:50.205686 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-647f12c7-c2b7-4833-bc3e-a4872eb64147 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:15:50.349279 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-647f12c7-c2b7-4833-bc3e-a4872eb64147 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b0f5728f244578741648259bbcd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92a32956353454db32509526ff751da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:15:50.357641 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-647f12c7-c2b7-4833-bc3e-a4872eb64147 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] 10.222.0.69 "GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a" status: 200 len: 1759 microversion: 2.1 time: 0.165435 May 04 19:15:50.358220 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 535/1060] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:15:50 2022] GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a => generated 1759 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:16:01.233299 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-62e21230-7dc5-4662-a0bf-ea0b3db9ffd3 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1851375675", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-630419074", "security_groups": [{"name": "tempest-secgroup-smoke-329240155"}], "block_device_mapping_v2": [{"uuid": "c7594f84-912f-4284-a471-6c3f159a7b8f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f15a6490-097f-4027-b3d2-f33625a578b7"}]}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:16:01.338224 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.network.neutron [None req-62e21230-7dc5-4662-a0bf-ea0b3db9ffd3 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] validate_networks() for [('f15a6490-097f-4027-b3d2-f33625a578b7', None, None, None, None, None)] {{(pid=117125) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 04 19:16:01.694991 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-62e21230-7dc5-4662-a0bf-ea0b3db9ffd3 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Flavor limits 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 04 19:16:01.695409 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-62e21230-7dc5-4662-a0bf-ea0b3db9ffd3 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Image limits 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 04 19:16:01.695908 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-62e21230-7dc5-4662-a0bf-ea0b3db9ffd3 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Flavor pref 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 04 19:16:01.696310 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-62e21230-7dc5-4662-a0bf-ea0b3db9ffd3 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Image pref 0:0:0 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 04 19:16:01.696714 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.virt.hardware [None req-62e21230-7dc5-4662-a0bf-ea0b3db9ffd3 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 04 19:16:01.705769 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-62e21230-7dc5-4662-a0bf-ea0b3db9ffd3 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:16:01.706211 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-62e21230-7dc5-4662-a0bf-ea0b3db9ffd3 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:16:01.706996 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-62e21230-7dc5-4662-a0bf-ea0b3db9ffd3 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:16:01.707427 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-62e21230-7dc5-4662-a0bf-ea0b3db9ffd3 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:16:01.723591 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-62e21230-7dc5-4662-a0bf-ea0b3db9ffd3 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Getting quotas for project 157e9c40125e42b4b5a908fc58bfa939. Resources: {'cores', 'ram', 'instances'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 04 19:16:01.727316 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.quota [None req-62e21230-7dc5-4662-a0bf-ea0b3db9ffd3 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Getting quotas for user 3c8b295066bc4ae695f6e60b9b3dc5dd and project 157e9c40125e42b4b5a908fc58bfa939. Resources: {'cores', 'ram', 'instances'} {{(pid=117125) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 04 19:16:01.781817 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-62e21230-7dc5-4662-a0bf-ea0b3db9ffd3 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Going to run 1 instances... {{(pid=117125) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 04 19:16:01.783890 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-62e21230-7dc5-4662-a0bf-ea0b3db9ffd3 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: dc2fd560-b378-476b-9b97-6c5a413a7c3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c7594f84-912f-4284-a471-6c3f159a7b8f',volume_size=None,volume_type=None)] {{(pid=117125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 04 19:16:01.906010 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-62e21230-7dc5-4662-a0bf-ea0b3db9ffd3 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.677267 May 04 19:16:01.906639 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 526/1061] 10.222.0.69 () {60 vars in 1146 bytes} [Wed May 4 19:16:01 2022] POST /compute/v2.1/servers => generated 405 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 04 19:16:01.916557 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-693d3457-04c5-4228-a842-9fffb3d7c92e tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:16:01.917163 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-693d3457-04c5-4228-a842-9fffb3d7c92e tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: dc2fd560-b378-476b-9b97-6c5a413a7c3a] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:16:01.969003 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-693d3457-04c5-4228-a842-9fffb3d7c92e tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8b295066bc4ae695f6e60b9b3dc5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157e9c40125e42b4b5a908fc58bfa939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:16:01.979747 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-693d3457-04c5-4228-a842-9fffb3d7c92e tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "GET /compute/v2.1/servers/dc2fd560-b378-476b-9b97-6c5a413a7c3a" status: 200 len: 1094 microversion: 2.1 time: 0.067020 May 04 19:16:01.980323 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 536/1062] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:16:01 2022] GET /compute/v2.1/servers/dc2fd560-b378-476b-9b97-6c5a413a7c3a => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:16:02.996361 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-08be391b-3ec6-4c00-b7be-e3353f97423d tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:16:02.998226 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-08be391b-3ec6-4c00-b7be-e3353f97423d tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: dc2fd560-b378-476b-9b97-6c5a413a7c3a] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:16:03.005212 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-08be391b-3ec6-4c00-b7be-e3353f97423d tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:16:03.005701 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-08be391b-3ec6-4c00-b7be-e3353f97423d tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:16:03.006520 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-08be391b-3ec6-4c00-b7be-e3353f97423d tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:16:03.006994 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-08be391b-3ec6-4c00-b7be-e3353f97423d tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:16:03.069091 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-08be391b-3ec6-4c00-b7be-e3353f97423d tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8b295066bc4ae695f6e60b9b3dc5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157e9c40125e42b4b5a908fc58bfa939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:16:03.076692 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-08be391b-3ec6-4c00-b7be-e3353f97423d tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "GET /compute/v2.1/servers/dc2fd560-b378-476b-9b97-6c5a413a7c3a" status: 200 len: 1210 microversion: 2.1 time: 0.084425 May 04 19:16:03.077335 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 527/1063] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:16:02 2022] GET /compute/v2.1/servers/dc2fd560-b378-476b-9b97-6c5a413a7c3a => generated 1210 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:16:04.096369 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-96e8f3c3-f101-4150-b292-a580f3dbbd5f tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:16:04.096988 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-96e8f3c3-f101-4150-b292-a580f3dbbd5f tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: dc2fd560-b378-476b-9b97-6c5a413a7c3a] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:16:04.103482 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-96e8f3c3-f101-4150-b292-a580f3dbbd5f tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:16:04.104165 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-96e8f3c3-f101-4150-b292-a580f3dbbd5f tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:16:04.105141 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-96e8f3c3-f101-4150-b292-a580f3dbbd5f tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:16:04.105804 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-96e8f3c3-f101-4150-b292-a580f3dbbd5f tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:16:04.291942 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-96e8f3c3-f101-4150-b292-a580f3dbbd5f tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8b295066bc4ae695f6e60b9b3dc5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157e9c40125e42b4b5a908fc58bfa939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:16:04.299967 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-96e8f3c3-f101-4150-b292-a580f3dbbd5f tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "GET /compute/v2.1/servers/dc2fd560-b378-476b-9b97-6c5a413a7c3a" status: 200 len: 1265 microversion: 2.1 time: 0.207557 May 04 19:16:04.300628 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 537/1064] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:16:04 2022] GET /compute/v2.1/servers/dc2fd560-b378-476b-9b97-6c5a413a7c3a => generated 1265 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:16:04.371495 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-7342f669-4808-408c-8dc2-ea91465876b5 req-06754463-1683-457c-bcb2-5d8f6bdb8820 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc2fd560-b378-476b-9b97-6c5a413a7c3a", "tag": "0a804905-ca47-495b-8f36-12134c37f994"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:16:04.383478 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-7342f669-4808-408c-8dc2-ea91465876b5 req-06754463-1683-457c-bcb2-5d8f6bdb8820 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:16:04.384467 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-7342f669-4808-408c-8dc2-ea91465876b5 req-06754463-1683-457c-bcb2-5d8f6bdb8820 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:16:04.397797 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-7342f669-4808-408c-8dc2-ea91465876b5 req-06754463-1683-457c-bcb2-5d8f6bdb8820 service nova] Creating event network-changed:0a804905-ca47-495b-8f36-12134c37f994 for instance dc2fd560-b378-476b-9b97-6c5a413a7c3a on hv-cinder-83090 May 04 19:16:04.402770 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-7342f669-4808-408c-8dc2-ea91465876b5 req-06754463-1683-457c-bcb2-5d8f6bdb8820 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037365 May 04 19:16:04.403653 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 528/1065] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 04 19:16:05.316884 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-69d9eb43-64ed-4c43-b1d5-e67b8091ac14 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:16:05.317518 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-69d9eb43-64ed-4c43-b1d5-e67b8091ac14 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: dc2fd560-b378-476b-9b97-6c5a413a7c3a] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:16:05.323737 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-69d9eb43-64ed-4c43-b1d5-e67b8091ac14 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:16:05.324186 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-69d9eb43-64ed-4c43-b1d5-e67b8091ac14 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:16:05.324945 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-69d9eb43-64ed-4c43-b1d5-e67b8091ac14 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:16:05.325410 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-69d9eb43-64ed-4c43-b1d5-e67b8091ac14 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:16:05.537798 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-69d9eb43-64ed-4c43-b1d5-e67b8091ac14 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8b295066bc4ae695f6e60b9b3dc5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157e9c40125e42b4b5a908fc58bfa939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:16:05.545902 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-69d9eb43-64ed-4c43-b1d5-e67b8091ac14 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "GET /compute/v2.1/servers/dc2fd560-b378-476b-9b97-6c5a413a7c3a" status: 200 len: 1265 microversion: 2.1 time: 0.232974 May 04 19:16:05.546481 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 538/1066] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:16:05 2022] GET /compute/v2.1/servers/dc2fd560-b378-476b-9b97-6c5a413a7c3a => generated 1265 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:16:06.564176 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-1dba8c81-36f4-42a4-956d-a0336a7e6f9b tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:16:06.564873 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-1dba8c81-36f4-42a4-956d-a0336a7e6f9b tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: dc2fd560-b378-476b-9b97-6c5a413a7c3a] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:16:06.570826 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1dba8c81-36f4-42a4-956d-a0336a7e6f9b tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:16:06.571273 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1dba8c81-36f4-42a4-956d-a0336a7e6f9b tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:16:06.572035 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1dba8c81-36f4-42a4-956d-a0336a7e6f9b tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:16:06.572468 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1dba8c81-36f4-42a4-956d-a0336a7e6f9b tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:16:06.709933 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-1dba8c81-36f4-42a4-956d-a0336a7e6f9b tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8b295066bc4ae695f6e60b9b3dc5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157e9c40125e42b4b5a908fc58bfa939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:16:06.717800 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-1dba8c81-36f4-42a4-956d-a0336a7e6f9b tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "GET /compute/v2.1/servers/dc2fd560-b378-476b-9b97-6c5a413a7c3a" status: 200 len: 1265 microversion: 2.1 time: 0.158838 May 04 19:16:06.718361 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 529/1067] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:16:06 2022] GET /compute/v2.1/servers/dc2fd560-b378-476b-9b97-6c5a413a7c3a => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:16:07.734938 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-b98d37f3-3693-4a05-b420-3cfd2b887ea6 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:16:07.735582 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-b98d37f3-3693-4a05-b420-3cfd2b887ea6 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: dc2fd560-b378-476b-9b97-6c5a413a7c3a] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:16:07.741864 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b98d37f3-3693-4a05-b420-3cfd2b887ea6 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:16:07.742316 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b98d37f3-3693-4a05-b420-3cfd2b887ea6 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:16:07.743085 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b98d37f3-3693-4a05-b420-3cfd2b887ea6 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:16:07.743553 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-b98d37f3-3693-4a05-b420-3cfd2b887ea6 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:16:07.871679 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-b98d37f3-3693-4a05-b420-3cfd2b887ea6 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8b295066bc4ae695f6e60b9b3dc5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157e9c40125e42b4b5a908fc58bfa939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:16:07.878894 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-b98d37f3-3693-4a05-b420-3cfd2b887ea6 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "GET /compute/v2.1/servers/dc2fd560-b378-476b-9b97-6c5a413a7c3a" status: 200 len: 1265 microversion: 2.1 time: 0.148490 May 04 19:16:07.879459 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 539/1068] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:16:07 2022] GET /compute/v2.1/servers/dc2fd560-b378-476b-9b97-6c5a413a7c3a => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:16:08.895871 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-247ec56d-b87e-45e1-98dd-a10928a8eff7 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:16:08.896473 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-247ec56d-b87e-45e1-98dd-a10928a8eff7 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: dc2fd560-b378-476b-9b97-6c5a413a7c3a] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:16:08.902721 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-247ec56d-b87e-45e1-98dd-a10928a8eff7 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:16:08.903167 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-247ec56d-b87e-45e1-98dd-a10928a8eff7 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:16:08.903918 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-247ec56d-b87e-45e1-98dd-a10928a8eff7 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:16:08.904351 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-247ec56d-b87e-45e1-98dd-a10928a8eff7 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:16:09.034807 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-247ec56d-b87e-45e1-98dd-a10928a8eff7 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8b295066bc4ae695f6e60b9b3dc5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157e9c40125e42b4b5a908fc58bfa939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:16:09.042110 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-247ec56d-b87e-45e1-98dd-a10928a8eff7 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "GET /compute/v2.1/servers/dc2fd560-b378-476b-9b97-6c5a413a7c3a" status: 200 len: 1265 microversion: 2.1 time: 0.150114 May 04 19:16:09.042669 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 530/1069] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:16:08 2022] GET /compute/v2.1/servers/dc2fd560-b378-476b-9b97-6c5a413a7c3a => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:16:10.059452 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-d2c84822-d595-456a-ad5e-d3482fadd184 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:16:10.060079 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-d2c84822-d595-456a-ad5e-d3482fadd184 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: dc2fd560-b378-476b-9b97-6c5a413a7c3a] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:16:10.066992 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d2c84822-d595-456a-ad5e-d3482fadd184 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:16:10.067448 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d2c84822-d595-456a-ad5e-d3482fadd184 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:16:10.068220 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d2c84822-d595-456a-ad5e-d3482fadd184 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:16:10.068662 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d2c84822-d595-456a-ad5e-d3482fadd184 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:16:10.193240 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-d2c84822-d595-456a-ad5e-d3482fadd184 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8b295066bc4ae695f6e60b9b3dc5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157e9c40125e42b4b5a908fc58bfa939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:16:10.200440 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-d2c84822-d595-456a-ad5e-d3482fadd184 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "GET /compute/v2.1/servers/dc2fd560-b378-476b-9b97-6c5a413a7c3a" status: 200 len: 1265 microversion: 2.1 time: 0.144901 May 04 19:16:10.201014 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 540/1070] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:16:10 2022] GET /compute/v2.1/servers/dc2fd560-b378-476b-9b97-6c5a413a7c3a => generated 1265 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:16:11.217406 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-2226134a-cad2-465e-871a-182e0c21b63a tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:16:11.218729 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-2226134a-cad2-465e-871a-182e0c21b63a tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: dc2fd560-b378-476b-9b97-6c5a413a7c3a] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:16:11.225273 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2226134a-cad2-465e-871a-182e0c21b63a tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:16:11.225756 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2226134a-cad2-465e-871a-182e0c21b63a tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:16:11.226531 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2226134a-cad2-465e-871a-182e0c21b63a tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:16:11.226971 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2226134a-cad2-465e-871a-182e0c21b63a tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:16:11.366609 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-2226134a-cad2-465e-871a-182e0c21b63a tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8b295066bc4ae695f6e60b9b3dc5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157e9c40125e42b4b5a908fc58bfa939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:16:11.374426 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-2226134a-cad2-465e-871a-182e0c21b63a tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "GET /compute/v2.1/servers/dc2fd560-b378-476b-9b97-6c5a413a7c3a" status: 200 len: 1265 microversion: 2.1 time: 0.160862 May 04 19:16:11.375035 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 531/1071] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:16:11 2022] GET /compute/v2.1/servers/dc2fd560-b378-476b-9b97-6c5a413a7c3a => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:16:12.391156 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-7baa1510-08c3-4e1d-a829-e21862186817 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:16:12.391782 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-7baa1510-08c3-4e1d-a829-e21862186817 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: dc2fd560-b378-476b-9b97-6c5a413a7c3a] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:16:12.398051 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7baa1510-08c3-4e1d-a829-e21862186817 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:16:12.398502 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7baa1510-08c3-4e1d-a829-e21862186817 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:16:12.399296 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7baa1510-08c3-4e1d-a829-e21862186817 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:16:12.399734 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-7baa1510-08c3-4e1d-a829-e21862186817 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:16:12.527748 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-7baa1510-08c3-4e1d-a829-e21862186817 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8b295066bc4ae695f6e60b9b3dc5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157e9c40125e42b4b5a908fc58bfa939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:16:12.535475 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-7baa1510-08c3-4e1d-a829-e21862186817 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "GET /compute/v2.1/servers/dc2fd560-b378-476b-9b97-6c5a413a7c3a" status: 200 len: 1265 microversion: 2.1 time: 0.148437 May 04 19:16:12.536064 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 541/1072] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:16:12 2022] GET /compute/v2.1/servers/dc2fd560-b378-476b-9b97-6c5a413a7c3a => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:16:13.552587 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-615abe27-e1f0-4dca-b59c-2bc017e60e99 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:16:13.553186 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-615abe27-e1f0-4dca-b59c-2bc017e60e99 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: dc2fd560-b378-476b-9b97-6c5a413a7c3a] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:16:13.559083 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-615abe27-e1f0-4dca-b59c-2bc017e60e99 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:16:13.559532 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-615abe27-e1f0-4dca-b59c-2bc017e60e99 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:16:13.560288 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-615abe27-e1f0-4dca-b59c-2bc017e60e99 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:16:13.560877 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-615abe27-e1f0-4dca-b59c-2bc017e60e99 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:16:13.831477 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-615abe27-e1f0-4dca-b59c-2bc017e60e99 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8b295066bc4ae695f6e60b9b3dc5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157e9c40125e42b4b5a908fc58bfa939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:16:13.838817 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-615abe27-e1f0-4dca-b59c-2bc017e60e99 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "GET /compute/v2.1/servers/dc2fd560-b378-476b-9b97-6c5a413a7c3a" status: 200 len: 1265 microversion: 2.1 time: 0.290239 May 04 19:16:13.839389 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 532/1073] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:16:13 2022] GET /compute/v2.1/servers/dc2fd560-b378-476b-9b97-6c5a413a7c3a => generated 1265 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:16:14.229577 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-e657edbb-b3e6-469b-9cb6-68d82d4cc1d2 req-7346915d-588a-4994-b4ac-e0bb12e9ab31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc2fd560-b378-476b-9b97-6c5a413a7c3a", "name": "network-vif-plugged", "status": "completed", "tag": "0a804905-ca47-495b-8f36-12134c37f994"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:16:14.240094 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-e657edbb-b3e6-469b-9cb6-68d82d4cc1d2 req-7346915d-588a-4994-b4ac-e0bb12e9ab31 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:16:14.240537 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-e657edbb-b3e6-469b-9cb6-68d82d4cc1d2 req-7346915d-588a-4994-b4ac-e0bb12e9ab31 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:16:14.251982 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-e657edbb-b3e6-469b-9cb6-68d82d4cc1d2 req-7346915d-588a-4994-b4ac-e0bb12e9ab31 service nova] Creating event network-vif-plugged:0a804905-ca47-495b-8f36-12134c37f994 for instance dc2fd560-b378-476b-9b97-6c5a413a7c3a on hv-cinder-83090 May 04 19:16:14.257637 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-e657edbb-b3e6-469b-9cb6-68d82d4cc1d2 req-7346915d-588a-4994-b4ac-e0bb12e9ab31 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031705 May 04 19:16:14.258400 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 542/1074] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:16:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:16:14.855898 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-054a38c2-2a5a-451a-9aad-55bbf580c7a9 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:16:14.856505 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-054a38c2-2a5a-451a-9aad-55bbf580c7a9 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: dc2fd560-b378-476b-9b97-6c5a413a7c3a] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:16:14.863329 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-054a38c2-2a5a-451a-9aad-55bbf580c7a9 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:16:14.863773 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-054a38c2-2a5a-451a-9aad-55bbf580c7a9 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:16:14.864546 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-054a38c2-2a5a-451a-9aad-55bbf580c7a9 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:16:14.864968 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-054a38c2-2a5a-451a-9aad-55bbf580c7a9 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:16:14.991912 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-054a38c2-2a5a-451a-9aad-55bbf580c7a9 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8b295066bc4ae695f6e60b9b3dc5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157e9c40125e42b4b5a908fc58bfa939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:16:14.999903 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-054a38c2-2a5a-451a-9aad-55bbf580c7a9 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "GET /compute/v2.1/servers/dc2fd560-b378-476b-9b97-6c5a413a7c3a" status: 200 len: 1265 microversion: 2.1 time: 0.147851 May 04 19:16:15.000460 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 533/1075] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:16:14 2022] GET /compute/v2.1/servers/dc2fd560-b378-476b-9b97-6c5a413a7c3a => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:16:16.017524 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-c52e4252-8cbb-49f1-a0d7-5fb1749378d1 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:16:16.018344 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-c52e4252-8cbb-49f1-a0d7-5fb1749378d1 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: dc2fd560-b378-476b-9b97-6c5a413a7c3a] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:16:16.024936 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c52e4252-8cbb-49f1-a0d7-5fb1749378d1 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:16:16.025381 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c52e4252-8cbb-49f1-a0d7-5fb1749378d1 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:16:16.026179 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c52e4252-8cbb-49f1-a0d7-5fb1749378d1 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:16:16.026619 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c52e4252-8cbb-49f1-a0d7-5fb1749378d1 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:16:16.215622 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-c52e4252-8cbb-49f1-a0d7-5fb1749378d1 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8b295066bc4ae695f6e60b9b3dc5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157e9c40125e42b4b5a908fc58bfa939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:16:16.222930 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-c52e4252-8cbb-49f1-a0d7-5fb1749378d1 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "GET /compute/v2.1/servers/dc2fd560-b378-476b-9b97-6c5a413a7c3a" status: 200 len: 1265 microversion: 2.1 time: 0.210583 May 04 19:16:16.223491 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 543/1076] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:16:16 2022] GET /compute/v2.1/servers/dc2fd560-b378-476b-9b97-6c5a413a7c3a => generated 1265 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:16:17.239942 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-e6d7f0b2-c828-4a57-9d34-3c09d312e782 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:16:17.240477 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-e6d7f0b2-c828-4a57-9d34-3c09d312e782 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: dc2fd560-b378-476b-9b97-6c5a413a7c3a] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:16:17.246756 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e6d7f0b2-c828-4a57-9d34-3c09d312e782 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:16:17.247201 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e6d7f0b2-c828-4a57-9d34-3c09d312e782 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:16:17.247952 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e6d7f0b2-c828-4a57-9d34-3c09d312e782 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:16:17.248382 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e6d7f0b2-c828-4a57-9d34-3c09d312e782 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:16:17.377553 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-e6d7f0b2-c828-4a57-9d34-3c09d312e782 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8b295066bc4ae695f6e60b9b3dc5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157e9c40125e42b4b5a908fc58bfa939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:16:17.384827 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-e6d7f0b2-c828-4a57-9d34-3c09d312e782 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "GET /compute/v2.1/servers/dc2fd560-b378-476b-9b97-6c5a413a7c3a" status: 200 len: 1452 microversion: 2.1 time: 0.148814 May 04 19:16:17.385387 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 534/1077] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:16:17 2022] GET /compute/v2.1/servers/dc2fd560-b378-476b-9b97-6c5a413a7c3a => generated 1452 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:16:17.401255 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-e220c566-3d4a-4c30-8d75-d21118887afa tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:16:17.401962 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-e220c566-3d4a-4c30-8d75-d21118887afa tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: dc2fd560-b378-476b-9b97-6c5a413a7c3a] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:16:17.408751 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e220c566-3d4a-4c30-8d75-d21118887afa tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:16:17.409196 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e220c566-3d4a-4c30-8d75-d21118887afa tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:16:17.409980 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e220c566-3d4a-4c30-8d75-d21118887afa tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:16:17.410413 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-e220c566-3d4a-4c30-8d75-d21118887afa tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:16:17.534929 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-e220c566-3d4a-4c30-8d75-d21118887afa tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8b295066bc4ae695f6e60b9b3dc5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157e9c40125e42b4b5a908fc58bfa939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:16:17.542164 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-e220c566-3d4a-4c30-8d75-d21118887afa tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "GET /compute/v2.1/servers/dc2fd560-b378-476b-9b97-6c5a413a7c3a" status: 200 len: 1452 microversion: 2.1 time: 0.144708 May 04 19:16:17.542732 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 544/1078] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:16:17 2022] GET /compute/v2.1/servers/dc2fd560-b378-476b-9b97-6c5a413a7c3a => generated 1452 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:16:19.757925 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-5209c315-b957-4794-9546-90604769a68f req-efe7d148-d112-4cf4-b5da-3e12970ccc03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc2fd560-b378-476b-9b97-6c5a413a7c3a", "tag": "0a804905-ca47-495b-8f36-12134c37f994"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:16:19.764494 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-5209c315-b957-4794-9546-90604769a68f req-efe7d148-d112-4cf4-b5da-3e12970ccc03 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:16:19.765019 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-5209c315-b957-4794-9546-90604769a68f req-efe7d148-d112-4cf4-b5da-3e12970ccc03 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:16:19.776096 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-5209c315-b957-4794-9546-90604769a68f req-efe7d148-d112-4cf4-b5da-3e12970ccc03 service nova] Creating event network-changed:0a804905-ca47-495b-8f36-12134c37f994 for instance dc2fd560-b378-476b-9b97-6c5a413a7c3a on hv-cinder-83090 May 04 19:16:19.781671 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-5209c315-b957-4794-9546-90604769a68f req-efe7d148-d112-4cf4-b5da-3e12970ccc03 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029931 May 04 19:16:19.782346 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 535/1079] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:16:20.560538 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 04 19:16:20.561899 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: Wed May 4 19:16:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 04 19:16:28.620087 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-9da73c5e-2164-4340-ab9c-d98a06b87350 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-199764966"}} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:16:28.621015 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-9da73c5e-2164-4340-ab9c-d98a06b87350 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] [instance: d98e858d-adf1-4fe6-9650-784caa790d1a] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:16:28.626705 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9da73c5e-2164-4340-ab9c-d98a06b87350 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:16:28.627164 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9da73c5e-2164-4340-ab9c-d98a06b87350 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:16:28.627915 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9da73c5e-2164-4340-ab9c-d98a06b87350 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:16:28.628350 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9da73c5e-2164-4340-ab9c-d98a06b87350 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:16:28.751509 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.network.security_group_api [None req-9da73c5e-2164-4340-ab9c-d98a06b87350 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Removing security group 705a8451-8d57-4208-ba1d-a40eb04dd688 from port 9e010276-d5b3-4d5f-821f-294d451cebe7 May 04 19:16:29.087369 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-9da73c5e-2164-4340-ab9c-d98a06b87350 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] 10.222.0.69 "POST /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a/action" status: 202 len: 0 microversion: 2.1 time: 0.471143 May 04 19:16:29.091125 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 545/1080] 10.222.0.69 () {60 vars in 1277 bytes} [Wed May 4 19:16:28 2022] POST /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a/action => generated 0 bytes in 473 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 04 19:16:29.099765 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-bbe690e3-ac2c-4a96-864b-048b248ed200 req-8785f8db-1806-4c48-9b40-15f629501510 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d98e858d-adf1-4fe6-9650-784caa790d1a", "tag": "9e010276-d5b3-4d5f-821f-294d451cebe7"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:16:29.110131 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-bbe690e3-ac2c-4a96-864b-048b248ed200 req-8785f8db-1806-4c48-9b40-15f629501510 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:16:29.111095 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-bbe690e3-ac2c-4a96-864b-048b248ed200 req-8785f8db-1806-4c48-9b40-15f629501510 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:16:29.123979 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-bbe690e3-ac2c-4a96-864b-048b248ed200 req-8785f8db-1806-4c48-9b40-15f629501510 service nova] Creating event network-changed:9e010276-d5b3-4d5f-821f-294d451cebe7 for instance d98e858d-adf1-4fe6-9650-784caa790d1a on hv-cinder-83090 May 04 19:16:29.138137 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-bbe690e3-ac2c-4a96-864b-048b248ed200 req-8785f8db-1806-4c48-9b40-15f629501510 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041400 May 04 19:16:29.139060 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 536/1081] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:16:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:16:30.161409 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-76ced431-49ad-4f06-b717-a35831cacb71 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:16:30.161934 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-76ced431-49ad-4f06-b717-a35831cacb71 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] [instance: d98e858d-adf1-4fe6-9650-784caa790d1a] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:16:30.164475 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-62af94f4-191f-4706-a82b-941c1fa49e7a req-2a1f7761-24c3-4b6f-8d74-b2169819b608 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d98e858d-adf1-4fe6-9650-784caa790d1a", "tag": "9e010276-d5b3-4d5f-821f-294d451cebe7"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:16:30.168134 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-76ced431-49ad-4f06-b717-a35831cacb71 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:16:30.168581 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-76ced431-49ad-4f06-b717-a35831cacb71 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:16:30.170565 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-76ced431-49ad-4f06-b717-a35831cacb71 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:16:30.171001 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-76ced431-49ad-4f06-b717-a35831cacb71 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:16:30.172926 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-62af94f4-191f-4706-a82b-941c1fa49e7a req-2a1f7761-24c3-4b6f-8d74-b2169819b608 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:16:30.173431 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-62af94f4-191f-4706-a82b-941c1fa49e7a req-2a1f7761-24c3-4b6f-8d74-b2169819b608 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:16:30.184553 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-62af94f4-191f-4706-a82b-941c1fa49e7a req-2a1f7761-24c3-4b6f-8d74-b2169819b608 service nova] Creating event network-changed:9e010276-d5b3-4d5f-821f-294d451cebe7 for instance d98e858d-adf1-4fe6-9650-784caa790d1a on hv-cinder-83090 May 04 19:16:30.189417 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-62af94f4-191f-4706-a82b-941c1fa49e7a req-2a1f7761-24c3-4b6f-8d74-b2169819b608 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029331 May 04 19:16:30.190206 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 537/1082] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:16:30.251838 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.objects.instance [None req-76ced431-49ad-4f06-b717-a35831cacb71 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lazy-loading 'services' on Instance uuid d98e858d-adf1-4fe6-9650-784caa790d1a {{(pid=117124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 04 19:16:30.329206 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-76ced431-49ad-4f06-b717-a35831cacb71 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] 10.222.0.69 "DELETE /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a/os-volume_attachments/616469fe-6cd5-494a-894d-d51d71572dc2" status: 202 len: 0 microversion: 2.1 time: 0.171953 May 04 19:16:30.330194 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 546/1083] 10.222.0.69 () {58 vars in 1415 bytes} [Wed May 4 19:16:30 2022] DELETE /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a/os-volume_attachments/616469fe-6cd5-494a-894d-d51d71572dc2 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 04 19:16:30.345292 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-65a935e1-57f4-429f-8be7-bca5a7100da1 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:16:30.348919 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-65a935e1-57f4-429f-8be7-bca5a7100da1 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] [instance: d98e858d-adf1-4fe6-9650-784caa790d1a] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:16:30.357186 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-65a935e1-57f4-429f-8be7-bca5a7100da1 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:16:30.361249 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-65a935e1-57f4-429f-8be7-bca5a7100da1 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:16:30.363670 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-65a935e1-57f4-429f-8be7-bca5a7100da1 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:16:30.364119 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-65a935e1-57f4-429f-8be7-bca5a7100da1 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:16:30.399767 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-65a935e1-57f4-429f-8be7-bca5a7100da1 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] 10.222.0.69 "GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064853 May 04 19:16:30.400346 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 538/1084] 10.222.0.69 () {58 vars in 1301 bytes} [Wed May 4 19:16:30 2022] GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:16:31.412974 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-182dc1a4-0eb8-495a-8c74-f173ad264123 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:16:31.414001 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-182dc1a4-0eb8-495a-8c74-f173ad264123 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] [instance: d98e858d-adf1-4fe6-9650-784caa790d1a] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:16:31.420591 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-182dc1a4-0eb8-495a-8c74-f173ad264123 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:16:31.421040 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-182dc1a4-0eb8-495a-8c74-f173ad264123 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:16:31.421839 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-182dc1a4-0eb8-495a-8c74-f173ad264123 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:16:31.422289 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-182dc1a4-0eb8-495a-8c74-f173ad264123 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:16:31.450932 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-182dc1a4-0eb8-495a-8c74-f173ad264123 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] 10.222.0.69 "GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042396 May 04 19:16:31.451977 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 547/1085] 10.222.0.69 () {58 vars in 1301 bytes} [Wed May 4 19:16:31 2022] GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 04 19:16:31.461676 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-17d5f228-9857-4446-b4af-633ef15077db tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:16:31.462184 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-17d5f228-9857-4446-b4af-633ef15077db tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] [instance: d98e858d-adf1-4fe6-9650-784caa790d1a] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:16:31.469124 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-17d5f228-9857-4446-b4af-633ef15077db tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:16:31.469602 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-17d5f228-9857-4446-b4af-633ef15077db tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:16:31.470366 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-17d5f228-9857-4446-b4af-633ef15077db tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:16:31.470800 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-17d5f228-9857-4446-b4af-633ef15077db tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:16:31.541427 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.wsgi [None req-17d5f228-9857-4446-b4af-633ef15077db tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] HTTP exception thrown: Instance d98e858d-adf1-4fe6-9650-784caa790d1a is not attached to volume 616469fe-6cd5-494a-894d-d51d71572dc2 May 04 19:16:31.542092 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-17d5f228-9857-4446-b4af-633ef15077db tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Returning 404 to user: Instance d98e858d-adf1-4fe6-9650-784caa790d1a is not attached to volume 616469fe-6cd5-494a-894d-d51d71572dc2 {{(pid=117125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 04 19:16:31.542949 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-17d5f228-9857-4446-b4af-633ef15077db tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] 10.222.0.69 "DELETE /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a/os-volume_attachments/616469fe-6cd5-494a-894d-d51d71572dc2" status: 404 len: 154 microversion: 2.1 time: 0.085257 May 04 19:16:31.543487 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 539/1086] 10.222.0.69 () {58 vars in 1415 bytes} [Wed May 4 19:16:31 2022] DELETE /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a/os-volume_attachments/616469fe-6cd5-494a-894d-d51d71572dc2 => generated 154 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 04 19:16:32.671970 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-dc17598f-845a-435b-ad73-45b1636f15b4 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:16:32.672537 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-dc17598f-845a-435b-ad73-45b1636f15b4 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] [instance: d98e858d-adf1-4fe6-9650-784caa790d1a] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:16:32.679103 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-dc17598f-845a-435b-ad73-45b1636f15b4 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:16:32.679559 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-dc17598f-845a-435b-ad73-45b1636f15b4 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:16:32.680345 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-dc17598f-845a-435b-ad73-45b1636f15b4 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:16:32.680789 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-dc17598f-845a-435b-ad73-45b1636f15b4 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:16:32.708037 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-dc17598f-845a-435b-ad73-45b1636f15b4 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] [instance: d98e858d-adf1-4fe6-9650-784caa790d1a] Going to try to terminate instance {{(pid=117124) delete /opt/stack/nova/nova/compute/api.py:2664}} May 04 19:16:32.784778 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-dc17598f-845a-435b-ad73-45b1636f15b4 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] 10.222.0.69 "DELETE /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a" status: 204 len: 0 microversion: 2.1 time: 0.117759 May 04 19:16:32.785515 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 548/1087] 10.222.0.69 () {58 vars in 1238 bytes} [Wed May 4 19:16:32 2022] DELETE /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 04 19:16:32.794604 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-db7f18f3-3d18-4b50-8fdd-15e0f78c3ed2 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:16:32.795869 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-db7f18f3-3d18-4b50-8fdd-15e0f78c3ed2 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] [instance: d98e858d-adf1-4fe6-9650-784caa790d1a] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:16:32.802314 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-db7f18f3-3d18-4b50-8fdd-15e0f78c3ed2 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:16:32.802765 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-db7f18f3-3d18-4b50-8fdd-15e0f78c3ed2 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:16:32.803528 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-db7f18f3-3d18-4b50-8fdd-15e0f78c3ed2 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:16:32.803963 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-db7f18f3-3d18-4b50-8fdd-15e0f78c3ed2 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:16:32.929567 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-db7f18f3-3d18-4b50-8fdd-15e0f78c3ed2 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b0f5728f244578741648259bbcd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92a32956353454db32509526ff751da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:16:32.936919 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-db7f18f3-3d18-4b50-8fdd-15e0f78c3ed2 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] 10.222.0.69 "GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a" status: 200 len: 1555 microversion: 2.1 time: 0.147115 May 04 19:16:32.937478 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 540/1088] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:16:32 2022] GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a => generated 1555 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:16:33.954587 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-d524058b-915a-4584-989f-070e9061c664 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:16:33.955281 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-d524058b-915a-4584-989f-070e9061c664 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] [instance: d98e858d-adf1-4fe6-9650-784caa790d1a] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:16:33.961662 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d524058b-915a-4584-989f-070e9061c664 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:16:33.962111 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d524058b-915a-4584-989f-070e9061c664 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:16:33.962872 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d524058b-915a-4584-989f-070e9061c664 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:16:33.963302 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-d524058b-915a-4584-989f-070e9061c664 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:16:34.090278 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-d524058b-915a-4584-989f-070e9061c664 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b0f5728f244578741648259bbcd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92a32956353454db32509526ff751da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:16:34.098129 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-d524058b-915a-4584-989f-070e9061c664 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] 10.222.0.69 "GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a" status: 200 len: 1555 microversion: 2.1 time: 0.147787 May 04 19:16:34.098700 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 549/1089] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:16:33 2022] GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a => generated 1555 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:16:35.115856 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-26d7f57c-6e94-406f-96c3-bd50d05a0c17 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:16:35.116508 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-26d7f57c-6e94-406f-96c3-bd50d05a0c17 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] [instance: d98e858d-adf1-4fe6-9650-784caa790d1a] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:16:35.123563 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-26d7f57c-6e94-406f-96c3-bd50d05a0c17 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:16:35.124011 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-26d7f57c-6e94-406f-96c3-bd50d05a0c17 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:16:35.124767 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-26d7f57c-6e94-406f-96c3-bd50d05a0c17 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:16:35.125195 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-26d7f57c-6e94-406f-96c3-bd50d05a0c17 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:16:35.189264 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-26d7f57c-6e94-406f-96c3-bd50d05a0c17 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e0b0f5728f244578741648259bbcd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92a32956353454db32509526ff751da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:16:35.198518 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-26d7f57c-6e94-406f-96c3-bd50d05a0c17 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] 10.222.0.69 "GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a" status: 200 len: 1513 microversion: 2.1 time: 0.086648 May 04 19:16:35.199079 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 541/1090] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:16:35 2022] GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a => generated 1513 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:16:35.262556 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-9f429925-8cfb-4368-98d3-5dcb00e6932b req-3aae4f6a-859b-4fbe-916d-b45c978c7779 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d98e858d-adf1-4fe6-9650-784caa790d1a", "name": "network-vif-deleted", "tag": "9e010276-d5b3-4d5f-821f-294d451cebe7"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:16:35.271286 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-9f429925-8cfb-4368-98d3-5dcb00e6932b req-3aae4f6a-859b-4fbe-916d-b45c978c7779 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:16:35.271822 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-9f429925-8cfb-4368-98d3-5dcb00e6932b req-3aae4f6a-859b-4fbe-916d-b45c978c7779 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:16:35.282570 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-9f429925-8cfb-4368-98d3-5dcb00e6932b req-3aae4f6a-859b-4fbe-916d-b45c978c7779 service nova] Creating event network-vif-deleted:9e010276-d5b3-4d5f-821f-294d451cebe7 for instance d98e858d-adf1-4fe6-9650-784caa790d1a on hv-cinder-83090 May 04 19:16:35.287342 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-9f429925-8cfb-4368-98d3-5dcb00e6932b req-3aae4f6a-859b-4fbe-916d-b45c978c7779 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028493 May 04 19:16:35.287946 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 550/1091] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:16:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:16:36.215500 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-f5e06461-bb95-44e2-b6ff-820ec7ae8ecf tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:16:36.216114 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-f5e06461-bb95-44e2-b6ff-820ec7ae8ecf tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] [instance: d98e858d-adf1-4fe6-9650-784caa790d1a] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:16:36.223159 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f5e06461-bb95-44e2-b6ff-820ec7ae8ecf tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:16:36.223611 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f5e06461-bb95-44e2-b6ff-820ec7ae8ecf tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:16:36.224378 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f5e06461-bb95-44e2-b6ff-820ec7ae8ecf tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:16:36.224816 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f5e06461-bb95-44e2-b6ff-820ec7ae8ecf tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:16:36.238090 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.wsgi [None req-f5e06461-bb95-44e2-b6ff-820ec7ae8ecf tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] HTTP exception thrown: Instance d98e858d-adf1-4fe6-9650-784caa790d1a could not be found. May 04 19:16:36.238606 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-f5e06461-bb95-44e2-b6ff-820ec7ae8ecf tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Returning 404 to user: Instance d98e858d-adf1-4fe6-9650-784caa790d1a could not be found. {{(pid=117125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 04 19:16:36.239419 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-f5e06461-bb95-44e2-b6ff-820ec7ae8ecf tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] 10.222.0.69 "GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a" status: 404 len: 111 microversion: 2.1 time: 0.027861 May 04 19:16:36.239936 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 542/1092] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:16:36 2022] GET /compute/v2.1/servers/d98e858d-adf1-4fe6-9650-784caa790d1a => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 04 19:16:36.248983 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-480d72bd-1536-470c-9b4a-790476fc5166 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] Calling method '.version_select at 0x7fc3f628fb80>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:16:36.269391 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-480d72bd-1536-470c-9b4a-790476fc5166 tempest-TestMinimumBasicScenario-1284227856 tempest-TestMinimumBasicScenario-1284227856-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1493000720" status: 202 len: 0 microversion: 2.1 time: 0.025040 May 04 19:16:36.270023 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 551/1093] 10.222.0.69 () {58 vars in 1271 bytes} [Wed May 4 19:16:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1493000720 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 04 19:17:27.170829 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-7bc99987-11bd-4fc5-838f-3945d2d7d103 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:17:27.171454 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-7bc99987-11bd-4fc5-838f-3945d2d7d103 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] [instance: 92be652a-42d2-4b99-9dd4-c50102203b92] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:17:27.177257 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7bc99987-11bd-4fc5-838f-3945d2d7d103 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:27.177735 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7bc99987-11bd-4fc5-838f-3945d2d7d103 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:27.178492 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7bc99987-11bd-4fc5-838f-3945d2d7d103 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:27.178930 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7bc99987-11bd-4fc5-838f-3945d2d7d103 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:27.201086 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.objects.instance [None req-7bc99987-11bd-4fc5-838f-3945d2d7d103 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lazy-loading 'flavor' on Instance uuid 92be652a-42d2-4b99-9dd4-c50102203b92 {{(pid=117125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 04 19:17:27.271178 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-7bc99987-11bd-4fc5-838f-3945d2d7d103 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] 10.222.0.69 "POST /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92/action" status: 202 len: 0 microversion: 2.1 time: 0.104856 May 04 19:17:27.271702 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 543/1094] 10.222.0.69 () {60 vars in 1277 bytes} [Wed May 4 19:17:27 2022] POST /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 04 19:17:27.281004 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-9c55d451-10be-4eaa-8d2a-14e1af7f9673 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:17:27.281762 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-9c55d451-10be-4eaa-8d2a-14e1af7f9673 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] [instance: 92be652a-42d2-4b99-9dd4-c50102203b92] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:17:27.288792 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9c55d451-10be-4eaa-8d2a-14e1af7f9673 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:27.289241 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9c55d451-10be-4eaa-8d2a-14e1af7f9673 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:27.291729 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9c55d451-10be-4eaa-8d2a-14e1af7f9673 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:27.291729 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-9c55d451-10be-4eaa-8d2a-14e1af7f9673 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:27.421658 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-9c55d451-10be-4eaa-8d2a-14e1af7f9673 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa0cd8ed723418daf1cbd6933e0ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0c73a5efc84e348363ae368873f51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:17:27.428951 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-9c55d451-10be-4eaa-8d2a-14e1af7f9673 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] 10.222.0.69 "GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92" status: 200 len: 1565 microversion: 2.1 time: 0.152944 May 04 19:17:27.429531 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 552/1095] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:17:27 2022] GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92 => generated 1565 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:17:28.447707 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-e130142d-f42e-4fa6-b39c-6a7c6c923a52 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:17:28.448399 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-e130142d-f42e-4fa6-b39c-6a7c6c923a52 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] [instance: 92be652a-42d2-4b99-9dd4-c50102203b92] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:17:28.454548 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e130142d-f42e-4fa6-b39c-6a7c6c923a52 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:28.454991 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e130142d-f42e-4fa6-b39c-6a7c6c923a52 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:28.455746 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e130142d-f42e-4fa6-b39c-6a7c6c923a52 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:28.456178 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-e130142d-f42e-4fa6-b39c-6a7c6c923a52 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:28.581964 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-e130142d-f42e-4fa6-b39c-6a7c6c923a52 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa0cd8ed723418daf1cbd6933e0ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0c73a5efc84e348363ae368873f51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:17:28.589242 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-e130142d-f42e-4fa6-b39c-6a7c6c923a52 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] 10.222.0.69 "GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92" status: 200 len: 1565 microversion: 2.1 time: 0.146347 May 04 19:17:28.589840 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 544/1096] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:17:28 2022] GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92 => generated 1565 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:17:29.310121 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 04 19:17:29.310349 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: Wed May 4 19:17:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 04 19:17:29.606375 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-2ac16c4b-8dca-4938-aa8a-5a2c4b3298d7 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:17:29.606915 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-2ac16c4b-8dca-4938-aa8a-5a2c4b3298d7 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] [instance: 92be652a-42d2-4b99-9dd4-c50102203b92] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:17:29.613270 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2ac16c4b-8dca-4938-aa8a-5a2c4b3298d7 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:29.613745 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2ac16c4b-8dca-4938-aa8a-5a2c4b3298d7 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:29.614498 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2ac16c4b-8dca-4938-aa8a-5a2c4b3298d7 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:29.614926 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-2ac16c4b-8dca-4938-aa8a-5a2c4b3298d7 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:29.740634 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-2ac16c4b-8dca-4938-aa8a-5a2c4b3298d7 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa0cd8ed723418daf1cbd6933e0ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0c73a5efc84e348363ae368873f51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:17:29.748377 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-2ac16c4b-8dca-4938-aa8a-5a2c4b3298d7 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] 10.222.0.69 "GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92" status: 200 len: 1565 microversion: 2.1 time: 0.145472 May 04 19:17:29.748943 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 553/1097] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:17:29 2022] GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92 => generated 1565 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:17:30.766211 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-5acf7bdb-9243-4056-9f44-3cd502866a8a tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:17:30.767051 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-5acf7bdb-9243-4056-9f44-3cd502866a8a tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] [instance: 92be652a-42d2-4b99-9dd4-c50102203b92] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:17:30.773193 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5acf7bdb-9243-4056-9f44-3cd502866a8a tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:30.773681 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5acf7bdb-9243-4056-9f44-3cd502866a8a tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:30.774448 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5acf7bdb-9243-4056-9f44-3cd502866a8a tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:30.774883 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-5acf7bdb-9243-4056-9f44-3cd502866a8a tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:30.902313 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-5acf7bdb-9243-4056-9f44-3cd502866a8a tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa0cd8ed723418daf1cbd6933e0ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0c73a5efc84e348363ae368873f51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:17:30.910334 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-5acf7bdb-9243-4056-9f44-3cd502866a8a tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] 10.222.0.69 "GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92" status: 200 len: 1565 microversion: 2.1 time: 0.148790 May 04 19:17:30.910903 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 545/1098] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:17:30 2022] GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92 => generated 1565 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:17:31.927612 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-78b82e2a-07fd-49f6-a4e8-feb0c676442c tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:17:31.928225 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-78b82e2a-07fd-49f6-a4e8-feb0c676442c tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] [instance: 92be652a-42d2-4b99-9dd4-c50102203b92] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:17:31.934510 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-78b82e2a-07fd-49f6-a4e8-feb0c676442c tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:31.934972 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-78b82e2a-07fd-49f6-a4e8-feb0c676442c tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:31.935752 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-78b82e2a-07fd-49f6-a4e8-feb0c676442c tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:31.936187 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-78b82e2a-07fd-49f6-a4e8-feb0c676442c tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:32.000975 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 04 19:17:32.001205 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: Wed May 4 19:17:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92 (ip 10.222.0.69) !!! May 04 19:17:32.075011 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-78b82e2a-07fd-49f6-a4e8-feb0c676442c tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa0cd8ed723418daf1cbd6933e0ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0c73a5efc84e348363ae368873f51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:17:32.082919 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-78b82e2a-07fd-49f6-a4e8-feb0c676442c tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] 10.222.0.69 "GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92" status: 200 len: 1565 microversion: 2.1 time: 0.159172 May 04 19:17:32.083487 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 554/1099] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:17:31 2022] GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92 => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:17:33.100424 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-1d9178de-2d1b-4fee-be6e-2fb54ee7a802 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:17:33.101031 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-1d9178de-2d1b-4fee-be6e-2fb54ee7a802 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] [instance: 92be652a-42d2-4b99-9dd4-c50102203b92] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:17:33.107765 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1d9178de-2d1b-4fee-be6e-2fb54ee7a802 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:33.108237 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1d9178de-2d1b-4fee-be6e-2fb54ee7a802 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:33.109013 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1d9178de-2d1b-4fee-be6e-2fb54ee7a802 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:33.109445 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1d9178de-2d1b-4fee-be6e-2fb54ee7a802 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:33.235748 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-1d9178de-2d1b-4fee-be6e-2fb54ee7a802 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa0cd8ed723418daf1cbd6933e0ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0c73a5efc84e348363ae368873f51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:17:33.242961 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-1d9178de-2d1b-4fee-be6e-2fb54ee7a802 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] 10.222.0.69 "GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92" status: 200 len: 1565 microversion: 2.1 time: 0.146395 May 04 19:17:33.243518 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 546/1100] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:17:33 2022] GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92 => generated 1565 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:17:34.259947 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-a7ef879e-6c92-43d6-8836-b56380e4eadd tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:17:34.260492 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-a7ef879e-6c92-43d6-8836-b56380e4eadd tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] [instance: 92be652a-42d2-4b99-9dd4-c50102203b92] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:17:34.267769 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a7ef879e-6c92-43d6-8836-b56380e4eadd tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:34.268219 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a7ef879e-6c92-43d6-8836-b56380e4eadd tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:34.268980 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a7ef879e-6c92-43d6-8836-b56380e4eadd tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:34.269415 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a7ef879e-6c92-43d6-8836-b56380e4eadd tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:34.652714 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-a7ef879e-6c92-43d6-8836-b56380e4eadd tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa0cd8ed723418daf1cbd6933e0ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0c73a5efc84e348363ae368873f51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:17:34.660026 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-a7ef879e-6c92-43d6-8836-b56380e4eadd tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] 10.222.0.69 "GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92" status: 200 len: 1565 microversion: 2.1 time: 0.403962 May 04 19:17:34.660592 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 555/1101] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:17:34 2022] GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92 => generated 1565 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:17:35.677631 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-2e4b51d8-345b-406a-ba01-caae0a986313 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:17:35.678235 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-2e4b51d8-345b-406a-ba01-caae0a986313 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] [instance: 92be652a-42d2-4b99-9dd4-c50102203b92] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:17:35.684487 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2e4b51d8-345b-406a-ba01-caae0a986313 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:35.685437 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2e4b51d8-345b-406a-ba01-caae0a986313 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:35.686208 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2e4b51d8-345b-406a-ba01-caae0a986313 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:35.686638 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2e4b51d8-345b-406a-ba01-caae0a986313 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:35.811959 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-2e4b51d8-345b-406a-ba01-caae0a986313 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa0cd8ed723418daf1cbd6933e0ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0c73a5efc84e348363ae368873f51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:17:35.819215 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-2e4b51d8-345b-406a-ba01-caae0a986313 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] 10.222.0.69 "GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92" status: 200 len: 1565 microversion: 2.1 time: 0.145450 May 04 19:17:35.819775 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 547/1102] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:17:35 2022] GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92 => generated 1565 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:17:36.836283 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-549ff5a6-8d05-4ed1-a3be-bb6754da6740 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:17:36.836904 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-549ff5a6-8d05-4ed1-a3be-bb6754da6740 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] [instance: 92be652a-42d2-4b99-9dd4-c50102203b92] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:17:36.843845 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-549ff5a6-8d05-4ed1-a3be-bb6754da6740 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:36.844294 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-549ff5a6-8d05-4ed1-a3be-bb6754da6740 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:36.845059 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-549ff5a6-8d05-4ed1-a3be-bb6754da6740 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:36.845525 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-549ff5a6-8d05-4ed1-a3be-bb6754da6740 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:36.971598 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-549ff5a6-8d05-4ed1-a3be-bb6754da6740 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa0cd8ed723418daf1cbd6933e0ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0c73a5efc84e348363ae368873f51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:17:36.979036 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-549ff5a6-8d05-4ed1-a3be-bb6754da6740 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] 10.222.0.69 "GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92" status: 200 len: 1565 microversion: 2.1 time: 0.146594 May 04 19:17:36.979597 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 556/1103] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:17:36 2022] GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92 => generated 1565 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:17:37.996113 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-016ba6fb-6712-451c-8cd2-ef15431fcf1e tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:17:37.996726 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-016ba6fb-6712-451c-8cd2-ef15431fcf1e tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] [instance: 92be652a-42d2-4b99-9dd4-c50102203b92] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:17:38.003055 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-016ba6fb-6712-451c-8cd2-ef15431fcf1e tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:38.003500 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-016ba6fb-6712-451c-8cd2-ef15431fcf1e tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:38.004270 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-016ba6fb-6712-451c-8cd2-ef15431fcf1e tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:38.004703 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-016ba6fb-6712-451c-8cd2-ef15431fcf1e tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:38.141873 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-016ba6fb-6712-451c-8cd2-ef15431fcf1e tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa0cd8ed723418daf1cbd6933e0ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0c73a5efc84e348363ae368873f51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:17:38.149087 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-016ba6fb-6712-451c-8cd2-ef15431fcf1e tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] 10.222.0.69 "GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92" status: 200 len: 1565 microversion: 2.1 time: 0.156840 May 04 19:17:38.149671 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 548/1104] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:17:37 2022] GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92 => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:17:39.166818 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-5dba7388-97cf-4769-b685-96e8fb49d052 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:17:39.167428 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-5dba7388-97cf-4769-b685-96e8fb49d052 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] [instance: 92be652a-42d2-4b99-9dd4-c50102203b92] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:17:39.174279 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5dba7388-97cf-4769-b685-96e8fb49d052 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:39.174733 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5dba7388-97cf-4769-b685-96e8fb49d052 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:39.175484 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5dba7388-97cf-4769-b685-96e8fb49d052 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:39.175912 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5dba7388-97cf-4769-b685-96e8fb49d052 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:39.305971 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-5dba7388-97cf-4769-b685-96e8fb49d052 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa0cd8ed723418daf1cbd6933e0ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0c73a5efc84e348363ae368873f51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:17:39.313358 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-5dba7388-97cf-4769-b685-96e8fb49d052 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] 10.222.0.69 "GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92" status: 200 len: 1565 microversion: 2.1 time: 0.150393 May 04 19:17:39.313965 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 557/1105] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:17:39 2022] GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92 => generated 1565 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:17:40.331016 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-2b42449b-9794-4e1c-b56c-0bccd86a5c37 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:17:40.331639 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-2b42449b-9794-4e1c-b56c-0bccd86a5c37 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] [instance: 92be652a-42d2-4b99-9dd4-c50102203b92] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:17:40.339488 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2b42449b-9794-4e1c-b56c-0bccd86a5c37 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:40.339941 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2b42449b-9794-4e1c-b56c-0bccd86a5c37 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:40.340719 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2b42449b-9794-4e1c-b56c-0bccd86a5c37 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:40.341244 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-2b42449b-9794-4e1c-b56c-0bccd86a5c37 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:40.468149 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-2b42449b-9794-4e1c-b56c-0bccd86a5c37 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa0cd8ed723418daf1cbd6933e0ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0c73a5efc84e348363ae368873f51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:17:40.475505 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-2b42449b-9794-4e1c-b56c-0bccd86a5c37 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] 10.222.0.69 "GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92" status: 200 len: 1506 microversion: 2.1 time: 0.148400 May 04 19:17:40.476073 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 549/1106] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:17:40 2022] GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92 => generated 1506 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:17:40.492292 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-51a09f70-8e6e-44b1-95c4-1b340a03e261 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:17:40.492863 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-51a09f70-8e6e-44b1-95c4-1b340a03e261 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] [instance: 92be652a-42d2-4b99-9dd4-c50102203b92] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:17:40.499731 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-51a09f70-8e6e-44b1-95c4-1b340a03e261 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:40.500180 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-51a09f70-8e6e-44b1-95c4-1b340a03e261 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:40.500942 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-51a09f70-8e6e-44b1-95c4-1b340a03e261 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:40.501376 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-51a09f70-8e6e-44b1-95c4-1b340a03e261 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:40.574798 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-51a09f70-8e6e-44b1-95c4-1b340a03e261 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] 10.222.0.69 "POST /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92/action" status: 202 len: 0 microversion: 2.1 time: 0.086302 May 04 19:17:40.575470 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 558/1107] 10.222.0.69 () {60 vars in 1277 bytes} [Wed May 4 19:17:40 2022] POST /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 04 19:17:40.583615 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-ae495e50-877a-41a8-9eda-45fba72e9f73 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:17:40.584154 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-ae495e50-877a-41a8-9eda-45fba72e9f73 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] [instance: 92be652a-42d2-4b99-9dd4-c50102203b92] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:17:40.589904 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ae495e50-877a-41a8-9eda-45fba72e9f73 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:40.590352 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ae495e50-877a-41a8-9eda-45fba72e9f73 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:40.591111 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ae495e50-877a-41a8-9eda-45fba72e9f73 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:40.591540 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-ae495e50-877a-41a8-9eda-45fba72e9f73 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:40.748925 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-ae495e50-877a-41a8-9eda-45fba72e9f73 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa0cd8ed723418daf1cbd6933e0ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0c73a5efc84e348363ae368873f51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:17:40.756240 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-ae495e50-877a-41a8-9eda-45fba72e9f73 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] 10.222.0.69 "GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92" status: 200 len: 1514 microversion: 2.1 time: 0.176616 May 04 19:17:40.756800 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 550/1108] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:17:40 2022] GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92 => generated 1514 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:17:41.773616 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-745668b7-e312-4d68-b5d3-06ee49dec5b3 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:17:41.774229 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-745668b7-e312-4d68-b5d3-06ee49dec5b3 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] [instance: 92be652a-42d2-4b99-9dd4-c50102203b92] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:17:41.780455 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-745668b7-e312-4d68-b5d3-06ee49dec5b3 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:41.780901 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-745668b7-e312-4d68-b5d3-06ee49dec5b3 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:41.781696 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-745668b7-e312-4d68-b5d3-06ee49dec5b3 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:41.782127 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-745668b7-e312-4d68-b5d3-06ee49dec5b3 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:41.909626 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-745668b7-e312-4d68-b5d3-06ee49dec5b3 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa0cd8ed723418daf1cbd6933e0ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0c73a5efc84e348363ae368873f51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:17:41.916946 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-745668b7-e312-4d68-b5d3-06ee49dec5b3 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] 10.222.0.69 "GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92" status: 200 len: 1514 microversion: 2.1 time: 0.147160 May 04 19:17:41.917525 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 559/1109] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:17:41 2022] GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92 => generated 1514 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:17:42.696442 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-a23060e8-2d1c-4062-865c-b17bcdaeacf7 req-7678a9ac-f7c1-48dd-bfad-1cc6623f15a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92be652a-42d2-4b99-9dd4-c50102203b92", "name": "network-vif-unplugged", "status": "completed", "tag": "ed81644c-0d75-4430-8134-757799f98502"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:17:42.704754 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-a23060e8-2d1c-4062-865c-b17bcdaeacf7 req-7678a9ac-f7c1-48dd-bfad-1cc6623f15a2 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:42.705192 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-a23060e8-2d1c-4062-865c-b17bcdaeacf7 req-7678a9ac-f7c1-48dd-bfad-1cc6623f15a2 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:42.716500 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.compute.server_external_events [req-a23060e8-2d1c-4062-865c-b17bcdaeacf7 req-7678a9ac-f7c1-48dd-bfad-1cc6623f15a2 service nova] Unable to find a host for instance 92be652a-42d2-4b99-9dd4-c50102203b92. Dropping event network-vif-unplugged {{(pid=117125) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 04 19:17:42.717367 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-a23060e8-2d1c-4062-865c-b17bcdaeacf7 req-7678a9ac-f7c1-48dd-bfad-1cc6623f15a2 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.086798 May 04 19:17:42.717966 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 551/1110] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:17:42 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 88 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 04 19:17:42.935681 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-533bf793-ce2f-4c87-b53a-1bd95cb5f09d tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:17:42.936279 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-533bf793-ce2f-4c87-b53a-1bd95cb5f09d tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] [instance: 92be652a-42d2-4b99-9dd4-c50102203b92] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:17:42.942726 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-533bf793-ce2f-4c87-b53a-1bd95cb5f09d tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:42.943167 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-533bf793-ce2f-4c87-b53a-1bd95cb5f09d tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:42.943914 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-533bf793-ce2f-4c87-b53a-1bd95cb5f09d tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:42.944345 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-533bf793-ce2f-4c87-b53a-1bd95cb5f09d tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:43.071876 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-533bf793-ce2f-4c87-b53a-1bd95cb5f09d tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa0cd8ed723418daf1cbd6933e0ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0c73a5efc84e348363ae368873f51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:17:43.080099 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-533bf793-ce2f-4c87-b53a-1bd95cb5f09d tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] 10.222.0.69 "GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92" status: 200 len: 1514 microversion: 2.1 time: 0.148663 May 04 19:17:43.080702 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 560/1111] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:17:42 2022] GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:17:44.097790 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-9522c925-9697-4470-abda-239c02fc5784 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:17:44.098394 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-9522c925-9697-4470-abda-239c02fc5784 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] [instance: 92be652a-42d2-4b99-9dd4-c50102203b92] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:17:44.104327 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9522c925-9697-4470-abda-239c02fc5784 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:44.104770 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9522c925-9697-4470-abda-239c02fc5784 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:44.105553 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9522c925-9697-4470-abda-239c02fc5784 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:44.105984 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-9522c925-9697-4470-abda-239c02fc5784 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:44.234286 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-9522c925-9697-4470-abda-239c02fc5784 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa0cd8ed723418daf1cbd6933e0ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0c73a5efc84e348363ae368873f51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:17:44.241833 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-9522c925-9697-4470-abda-239c02fc5784 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] 10.222.0.69 "GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92" status: 200 len: 1514 microversion: 2.1 time: 0.147745 May 04 19:17:44.242389 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 552/1112] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:17:44 2022] GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92 => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:17:45.258915 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-3537063d-f9b2-4e4b-8c89-11a15079c9ec tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:17:45.259468 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-3537063d-f9b2-4e4b-8c89-11a15079c9ec tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] [instance: 92be652a-42d2-4b99-9dd4-c50102203b92] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:17:45.266049 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3537063d-f9b2-4e4b-8c89-11a15079c9ec tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:45.266495 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3537063d-f9b2-4e4b-8c89-11a15079c9ec tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:45.267258 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3537063d-f9b2-4e4b-8c89-11a15079c9ec tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:45.267695 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3537063d-f9b2-4e4b-8c89-11a15079c9ec tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:45.397252 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-3537063d-f9b2-4e4b-8c89-11a15079c9ec tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa0cd8ed723418daf1cbd6933e0ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0c73a5efc84e348363ae368873f51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:17:45.405427 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-3537063d-f9b2-4e4b-8c89-11a15079c9ec tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] 10.222.0.69 "GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92" status: 200 len: 1514 microversion: 2.1 time: 0.150518 May 04 19:17:45.406086 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 561/1113] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:17:45 2022] GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:17:46.423117 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-35b5a324-d477-4e47-a477-75f5669889db tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:17:46.423666 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-35b5a324-d477-4e47-a477-75f5669889db tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] [instance: 92be652a-42d2-4b99-9dd4-c50102203b92] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:17:46.430026 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-35b5a324-d477-4e47-a477-75f5669889db tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:46.430474 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-35b5a324-d477-4e47-a477-75f5669889db tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:46.431232 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-35b5a324-d477-4e47-a477-75f5669889db tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:46.431665 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-35b5a324-d477-4e47-a477-75f5669889db tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:46.564920 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-35b5a324-d477-4e47-a477-75f5669889db tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa0cd8ed723418daf1cbd6933e0ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0c73a5efc84e348363ae368873f51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:17:46.572278 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-35b5a324-d477-4e47-a477-75f5669889db tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] 10.222.0.69 "GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92" status: 200 len: 1572 microversion: 2.1 time: 0.153583 May 04 19:17:46.572843 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 553/1114] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:17:46 2022] GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92 => generated 1572 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:17:47.589726 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-6e462226-cda4-4540-9807-348a12deb928 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:17:47.590469 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-6e462226-cda4-4540-9807-348a12deb928 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] [instance: 92be652a-42d2-4b99-9dd4-c50102203b92] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:17:47.596802 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6e462226-cda4-4540-9807-348a12deb928 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:47.597319 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6e462226-cda4-4540-9807-348a12deb928 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:47.598102 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6e462226-cda4-4540-9807-348a12deb928 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:47.598540 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6e462226-cda4-4540-9807-348a12deb928 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:47.675461 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-1830bef8-4874-4034-bccc-94ce6e6217a7 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:17:47.676520 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-1830bef8-4874-4034-bccc-94ce6e6217a7 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: dc2fd560-b378-476b-9b97-6c5a413a7c3a] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:17:47.683012 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1830bef8-4874-4034-bccc-94ce6e6217a7 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:47.683463 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1830bef8-4874-4034-bccc-94ce6e6217a7 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:47.684978 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1830bef8-4874-4034-bccc-94ce6e6217a7 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:47.685611 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1830bef8-4874-4034-bccc-94ce6e6217a7 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:47.712243 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-1830bef8-4874-4034-bccc-94ce6e6217a7 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: dc2fd560-b378-476b-9b97-6c5a413a7c3a] Going to try to terminate instance {{(pid=117125) delete /opt/stack/nova/nova/compute/api.py:2664}} May 04 19:17:47.744415 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-6e462226-cda4-4540-9807-348a12deb928 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa0cd8ed723418daf1cbd6933e0ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0c73a5efc84e348363ae368873f51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:17:47.754385 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-6e462226-cda4-4540-9807-348a12deb928 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] 10.222.0.69 "GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92" status: 200 len: 1572 microversion: 2.1 time: 0.168259 May 04 19:17:47.755806 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 562/1115] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:17:47 2022] GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92 => generated 1572 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:17:47.805930 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-1830bef8-4874-4034-bccc-94ce6e6217a7 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "DELETE /compute/v2.1/servers/dc2fd560-b378-476b-9b97-6c5a413a7c3a" status: 204 len: 0 microversion: 2.1 time: 0.133930 May 04 19:17:47.811299 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 554/1116] 10.222.0.69 () {58 vars in 1238 bytes} [Wed May 4 19:17:47 2022] DELETE /compute/v2.1/servers/dc2fd560-b378-476b-9b97-6c5a413a7c3a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 04 19:17:47.816760 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-93489fce-3872-4cd3-ad72-26749078fd2c tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:17:47.817474 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-93489fce-3872-4cd3-ad72-26749078fd2c tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: dc2fd560-b378-476b-9b97-6c5a413a7c3a] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:17:47.824048 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-93489fce-3872-4cd3-ad72-26749078fd2c tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:47.824499 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-93489fce-3872-4cd3-ad72-26749078fd2c tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:47.825327 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-93489fce-3872-4cd3-ad72-26749078fd2c tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:47.825820 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-93489fce-3872-4cd3-ad72-26749078fd2c tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:47.831721 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-6a1901a2-5013-4905-b785-e61dc69c6610 req-854ff0f0-3c81-4be2-98e4-0d8bc8e6b6a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc2fd560-b378-476b-9b97-6c5a413a7c3a", "tag": "0a804905-ca47-495b-8f36-12134c37f994"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:17:47.840339 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-6a1901a2-5013-4905-b785-e61dc69c6610 req-854ff0f0-3c81-4be2-98e4-0d8bc8e6b6a5 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:47.841180 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-6a1901a2-5013-4905-b785-e61dc69c6610 req-854ff0f0-3c81-4be2-98e4-0d8bc8e6b6a5 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:47.853686 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-6a1901a2-5013-4905-b785-e61dc69c6610 req-854ff0f0-3c81-4be2-98e4-0d8bc8e6b6a5 service nova] Creating event network-changed:0a804905-ca47-495b-8f36-12134c37f994 for instance dc2fd560-b378-476b-9b97-6c5a413a7c3a on hv-cinder-83090 May 04 19:17:47.859847 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-6a1901a2-5013-4905-b785-e61dc69c6610 req-854ff0f0-3c81-4be2-98e4-0d8bc8e6b6a5 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101989 May 04 19:17:47.860689 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 563/1117] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:17:47.964340 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-93489fce-3872-4cd3-ad72-26749078fd2c tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8b295066bc4ae695f6e60b9b3dc5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157e9c40125e42b4b5a908fc58bfa939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:17:47.972122 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-93489fce-3872-4cd3-ad72-26749078fd2c tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "GET /compute/v2.1/servers/dc2fd560-b378-476b-9b97-6c5a413a7c3a" status: 200 len: 1577 microversion: 2.1 time: 0.159524 May 04 19:17:47.972863 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 555/1118] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:17:47 2022] GET /compute/v2.1/servers/dc2fd560-b378-476b-9b97-6c5a413a7c3a => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:17:48.774565 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-c56e8778-e60f-4ce4-9ed2-7b6964c38c13 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:17:48.775277 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-c56e8778-e60f-4ce4-9ed2-7b6964c38c13 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] [instance: 92be652a-42d2-4b99-9dd4-c50102203b92] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:17:48.782094 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c56e8778-e60f-4ce4-9ed2-7b6964c38c13 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:48.782544 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c56e8778-e60f-4ce4-9ed2-7b6964c38c13 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:48.783306 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c56e8778-e60f-4ce4-9ed2-7b6964c38c13 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:48.783746 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-c56e8778-e60f-4ce4-9ed2-7b6964c38c13 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:48.911728 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-c56e8778-e60f-4ce4-9ed2-7b6964c38c13 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa0cd8ed723418daf1cbd6933e0ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0c73a5efc84e348363ae368873f51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:17:48.919030 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-c56e8778-e60f-4ce4-9ed2-7b6964c38c13 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] 10.222.0.69 "GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92" status: 200 len: 1572 microversion: 2.1 time: 0.149175 May 04 19:17:48.919603 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 564/1119] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:17:48 2022] GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92 => generated 1572 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:17:48.989951 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-7bc3f205-6196-4542-ad61-7965930d9722 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:17:48.990560 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-7bc3f205-6196-4542-ad61-7965930d9722 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: dc2fd560-b378-476b-9b97-6c5a413a7c3a] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:17:48.996779 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7bc3f205-6196-4542-ad61-7965930d9722 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:48.997742 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7bc3f205-6196-4542-ad61-7965930d9722 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:48.998492 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7bc3f205-6196-4542-ad61-7965930d9722 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:48.998923 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-7bc3f205-6196-4542-ad61-7965930d9722 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:49.124758 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-7bc3f205-6196-4542-ad61-7965930d9722 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8b295066bc4ae695f6e60b9b3dc5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157e9c40125e42b4b5a908fc58bfa939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:17:49.132130 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-7bc3f205-6196-4542-ad61-7965930d9722 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "GET /compute/v2.1/servers/dc2fd560-b378-476b-9b97-6c5a413a7c3a" status: 200 len: 1577 microversion: 2.1 time: 0.145971 May 04 19:17:49.132699 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 556/1120] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:17:48 2022] GET /compute/v2.1/servers/dc2fd560-b378-476b-9b97-6c5a413a7c3a => generated 1577 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:17:49.936614 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-3f346e74-4bcc-40c5-a961-444d4a1a4009 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:17:49.937392 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-3f346e74-4bcc-40c5-a961-444d4a1a4009 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] [instance: 92be652a-42d2-4b99-9dd4-c50102203b92] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:17:49.944942 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3f346e74-4bcc-40c5-a961-444d4a1a4009 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:49.945965 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3f346e74-4bcc-40c5-a961-444d4a1a4009 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:49.946660 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3f346e74-4bcc-40c5-a961-444d4a1a4009 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:49.947172 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-3f346e74-4bcc-40c5-a961-444d4a1a4009 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:50.135687 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-3f346e74-4bcc-40c5-a961-444d4a1a4009 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa0cd8ed723418daf1cbd6933e0ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0c73a5efc84e348363ae368873f51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:17:50.144185 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-3f346e74-4bcc-40c5-a961-444d4a1a4009 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] 10.222.0.69 "GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92" status: 200 len: 1572 microversion: 2.1 time: 0.212001 May 04 19:17:50.145545 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 565/1121] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:17:49 2022] GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92 => generated 1572 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:17:50.154937 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-57a89b63-df31-432e-9ece-ec1cd50f7785 req-9fbf8b4e-e42f-4b6e-b4a8-53b587438ef3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc2fd560-b378-476b-9b97-6c5a413a7c3a", "name": "network-vif-deleted", "tag": "0a804905-ca47-495b-8f36-12134c37f994"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:17:50.161982 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-5bde3f56-ef47-4f6e-bfd0-e9f92961e5ee tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:17:50.162584 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-5bde3f56-ef47-4f6e-bfd0-e9f92961e5ee tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: dc2fd560-b378-476b-9b97-6c5a413a7c3a] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:17:50.168601 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5bde3f56-ef47-4f6e-bfd0-e9f92961e5ee tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:50.168921 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-57a89b63-df31-432e-9ece-ec1cd50f7785 req-9fbf8b4e-e42f-4b6e-b4a8-53b587438ef3 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:50.169104 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5bde3f56-ef47-4f6e-bfd0-e9f92961e5ee tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:50.169367 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-57a89b63-df31-432e-9ece-ec1cd50f7785 req-9fbf8b4e-e42f-4b6e-b4a8-53b587438ef3 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:50.169939 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5bde3f56-ef47-4f6e-bfd0-e9f92961e5ee tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:50.170411 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5bde3f56-ef47-4f6e-bfd0-e9f92961e5ee tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:50.180115 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-57a89b63-df31-432e-9ece-ec1cd50f7785 req-9fbf8b4e-e42f-4b6e-b4a8-53b587438ef3 service nova] Creating event network-vif-deleted:0a804905-ca47-495b-8f36-12134c37f994 for instance dc2fd560-b378-476b-9b97-6c5a413a7c3a on hv-cinder-83090 May 04 19:17:50.184994 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-57a89b63-df31-432e-9ece-ec1cd50f7785 req-9fbf8b4e-e42f-4b6e-b4a8-53b587438ef3 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097805 May 04 19:17:50.185610 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 557/1122] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:17:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 04 19:17:50.233195 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-5bde3f56-ef47-4f6e-bfd0-e9f92961e5ee tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8b295066bc4ae695f6e60b9b3dc5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157e9c40125e42b4b5a908fc58bfa939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:17:50.240654 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-5bde3f56-ef47-4f6e-bfd0-e9f92961e5ee tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "GET /compute/v2.1/servers/dc2fd560-b378-476b-9b97-6c5a413a7c3a" status: 200 len: 1225 microversion: 2.1 time: 0.093741 May 04 19:17:50.241221 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 566/1123] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:17:50 2022] GET /compute/v2.1/servers/dc2fd560-b378-476b-9b97-6c5a413a7c3a => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:17:51.162749 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-1c479b32-3a36-40a0-a36b-8059cff5ff66 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:17:51.163449 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-1c479b32-3a36-40a0-a36b-8059cff5ff66 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] [instance: 92be652a-42d2-4b99-9dd4-c50102203b92] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:17:51.170090 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1c479b32-3a36-40a0-a36b-8059cff5ff66 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:51.170540 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1c479b32-3a36-40a0-a36b-8059cff5ff66 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:51.171297 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1c479b32-3a36-40a0-a36b-8059cff5ff66 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:51.171731 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1c479b32-3a36-40a0-a36b-8059cff5ff66 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:51.258262 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-4bbea09f-4744-4c6b-a306-2133e09a6a25 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:17:51.258873 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-4bbea09f-4744-4c6b-a306-2133e09a6a25 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: dc2fd560-b378-476b-9b97-6c5a413a7c3a] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:17:51.265393 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4bbea09f-4744-4c6b-a306-2133e09a6a25 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:51.265920 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4bbea09f-4744-4c6b-a306-2133e09a6a25 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:51.266929 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4bbea09f-4744-4c6b-a306-2133e09a6a25 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:51.267374 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4bbea09f-4744-4c6b-a306-2133e09a6a25 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:51.281336 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.wsgi [None req-4bbea09f-4744-4c6b-a306-2133e09a6a25 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] HTTP exception thrown: Instance dc2fd560-b378-476b-9b97-6c5a413a7c3a could not be found. May 04 19:17:51.281869 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-4bbea09f-4744-4c6b-a306-2133e09a6a25 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Returning 404 to user: Instance dc2fd560-b378-476b-9b97-6c5a413a7c3a could not be found. {{(pid=117124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 04 19:17:51.282682 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-4bbea09f-4744-4c6b-a306-2133e09a6a25 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "GET /compute/v2.1/servers/dc2fd560-b378-476b-9b97-6c5a413a7c3a" status: 404 len: 111 microversion: 2.1 time: 0.028275 May 04 19:17:51.283217 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 567/1124] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:17:51 2022] GET /compute/v2.1/servers/dc2fd560-b378-476b-9b97-6c5a413a7c3a => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 04 19:17:51.303815 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-1c479b32-3a36-40a0-a36b-8059cff5ff66 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa0cd8ed723418daf1cbd6933e0ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0c73a5efc84e348363ae368873f51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:17:51.311086 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-1c479b32-3a36-40a0-a36b-8059cff5ff66 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] 10.222.0.69 "GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92" status: 200 len: 1572 microversion: 2.1 time: 0.152960 May 04 19:17:51.311653 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 558/1125] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:17:51 2022] GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92 => generated 1572 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:17:52.328787 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-547b23fa-e43c-42a3-a448-b50708212bdf tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:17:52.329424 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-547b23fa-e43c-42a3-a448-b50708212bdf tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] [instance: 92be652a-42d2-4b99-9dd4-c50102203b92] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:17:52.335687 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-547b23fa-e43c-42a3-a448-b50708212bdf tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:52.336128 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-547b23fa-e43c-42a3-a448-b50708212bdf tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:52.336877 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-547b23fa-e43c-42a3-a448-b50708212bdf tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:52.337315 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-547b23fa-e43c-42a3-a448-b50708212bdf tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:52.472843 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-547b23fa-e43c-42a3-a448-b50708212bdf tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa0cd8ed723418daf1cbd6933e0ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0c73a5efc84e348363ae368873f51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:17:52.482125 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-547b23fa-e43c-42a3-a448-b50708212bdf tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] 10.222.0.69 "GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92" status: 200 len: 1572 microversion: 2.1 time: 0.157644 May 04 19:17:52.482801 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 568/1126] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:17:52 2022] GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92 => generated 1572 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:17:53.498385 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-f706cd81-5b3c-4ad9-898f-6e837d8a828f tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:17:53.498983 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-f706cd81-5b3c-4ad9-898f-6e837d8a828f tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] [instance: 92be652a-42d2-4b99-9dd4-c50102203b92] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:17:53.506166 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f706cd81-5b3c-4ad9-898f-6e837d8a828f tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:53.506782 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f706cd81-5b3c-4ad9-898f-6e837d8a828f tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:53.507556 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f706cd81-5b3c-4ad9-898f-6e837d8a828f tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:53.508070 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-f706cd81-5b3c-4ad9-898f-6e837d8a828f tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:53.721070 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-f706cd81-5b3c-4ad9-898f-6e837d8a828f tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa0cd8ed723418daf1cbd6933e0ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0c73a5efc84e348363ae368873f51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:17:53.728551 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-f706cd81-5b3c-4ad9-898f-6e837d8a828f tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] 10.222.0.69 "GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92" status: 200 len: 1572 microversion: 2.1 time: 0.234072 May 04 19:17:53.729123 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 559/1127] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:17:53 2022] GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92 => generated 1572 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:17:54.672145 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-a29f5691-dde7-4fc8-aa77-1922559511ff tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:17:54.677896 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-75d996c0-56d8-4939-98ee-6333361fede4 req-86f6527b-87ac-4361-b9c6-fe52bdb643bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf80016c-70bb-49d8-8c94-1f44a76084ac", "tag": "bbd412e0-d285-4a86-9b3a-addb7dfbd08b"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:17:54.678416 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-a29f5691-dde7-4fc8-aa77-1922559511ff tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: bf80016c-70bb-49d8-8c94-1f44a76084ac] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:17:54.689537 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a29f5691-dde7-4fc8-aa77-1922559511ff tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:54.690039 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a29f5691-dde7-4fc8-aa77-1922559511ff tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:54.690834 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a29f5691-dde7-4fc8-aa77-1922559511ff tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:54.691277 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a29f5691-dde7-4fc8-aa77-1922559511ff tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:54.693652 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-75d996c0-56d8-4939-98ee-6333361fede4 req-86f6527b-87ac-4361-b9c6-fe52bdb643bb service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:54.694096 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-75d996c0-56d8-4939-98ee-6333361fede4 req-86f6527b-87ac-4361-b9c6-fe52bdb643bb service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:54.707764 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-75d996c0-56d8-4939-98ee-6333361fede4 req-86f6527b-87ac-4361-b9c6-fe52bdb643bb service nova] Creating event network-changed:bbd412e0-d285-4a86-9b3a-addb7dfbd08b for instance bf80016c-70bb-49d8-8c94-1f44a76084ac on hv-cinder-83090 May 04 19:17:54.713785 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-75d996c0-56d8-4939-98ee-6333361fede4 req-86f6527b-87ac-4361-b9c6-fe52bdb643bb service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039799 May 04 19:17:54.714401 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 560/1128] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:17:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:17:54.727981 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-a29f5691-dde7-4fc8-aa77-1922559511ff tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: bf80016c-70bb-49d8-8c94-1f44a76084ac] Going to try to terminate instance {{(pid=117124) delete /opt/stack/nova/nova/compute/api.py:2664}} May 04 19:17:54.748220 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-1a8c38aa-dc91-48d4-a012-b74e970e6731 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:17:54.749361 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-1a8c38aa-dc91-48d4-a012-b74e970e6731 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] [instance: 92be652a-42d2-4b99-9dd4-c50102203b92] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:17:54.757109 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1a8c38aa-dc91-48d4-a012-b74e970e6731 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:54.757744 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1a8c38aa-dc91-48d4-a012-b74e970e6731 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:54.758998 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1a8c38aa-dc91-48d4-a012-b74e970e6731 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:54.759555 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-1a8c38aa-dc91-48d4-a012-b74e970e6731 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:54.844189 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-a29f5691-dde7-4fc8-aa77-1922559511ff tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "DELETE /compute/v2.1/servers/bf80016c-70bb-49d8-8c94-1f44a76084ac" status: 204 len: 0 microversion: 2.1 time: 0.174916 May 04 19:17:54.844749 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 569/1129] 10.222.0.69 () {58 vars in 1238 bytes} [Wed May 4 19:17:54 2022] DELETE /compute/v2.1/servers/bf80016c-70bb-49d8-8c94-1f44a76084ac => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 04 19:17:54.855336 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-0a73f022-507b-4d6c-9f15-6dc123814298 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:17:54.856259 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-0a73f022-507b-4d6c-9f15-6dc123814298 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: bf80016c-70bb-49d8-8c94-1f44a76084ac] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:17:54.871257 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0a73f022-507b-4d6c-9f15-6dc123814298 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:54.871903 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0a73f022-507b-4d6c-9f15-6dc123814298 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:54.872793 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0a73f022-507b-4d6c-9f15-6dc123814298 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:54.873339 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-0a73f022-507b-4d6c-9f15-6dc123814298 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:54.927757 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-1a8c38aa-dc91-48d4-a012-b74e970e6731 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa0cd8ed723418daf1cbd6933e0ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0c73a5efc84e348363ae368873f51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:17:54.936052 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-1a8c38aa-dc91-48d4-a012-b74e970e6731 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] 10.222.0.69 "GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92" status: 200 len: 1572 microversion: 2.1 time: 0.193563 May 04 19:17:54.945996 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 561/1130] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:17:54 2022] GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92 => generated 1572 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:17:55.027936 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-0a73f022-507b-4d6c-9f15-6dc123814298 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8b295066bc4ae695f6e60b9b3dc5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157e9c40125e42b4b5a908fc58bfa939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:17:55.035390 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-0a73f022-507b-4d6c-9f15-6dc123814298 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "GET /compute/v2.1/servers/bf80016c-70bb-49d8-8c94-1f44a76084ac" status: 200 len: 1576 microversion: 2.1 time: 0.185329 May 04 19:17:55.035993 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 570/1131] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:17:54 2022] GET /compute/v2.1/servers/bf80016c-70bb-49d8-8c94-1f44a76084ac => generated 1576 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:17:55.953267 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-dfd60ed9-33b8-4586-81f2-e6b766067ab0 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:17:55.954471 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-dfd60ed9-33b8-4586-81f2-e6b766067ab0 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] [instance: 92be652a-42d2-4b99-9dd4-c50102203b92] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:17:55.961251 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-dfd60ed9-33b8-4586-81f2-e6b766067ab0 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:55.961716 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-dfd60ed9-33b8-4586-81f2-e6b766067ab0 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:55.962740 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-dfd60ed9-33b8-4586-81f2-e6b766067ab0 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:55.963332 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-dfd60ed9-33b8-4586-81f2-e6b766067ab0 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:56.052015 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-8f9dcf9f-eb2d-43dc-b3d3-8bc813d5e409 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:17:56.052636 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-8f9dcf9f-eb2d-43dc-b3d3-8bc813d5e409 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: bf80016c-70bb-49d8-8c94-1f44a76084ac] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:17:56.058773 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8f9dcf9f-eb2d-43dc-b3d3-8bc813d5e409 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:56.059229 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8f9dcf9f-eb2d-43dc-b3d3-8bc813d5e409 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:56.060010 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8f9dcf9f-eb2d-43dc-b3d3-8bc813d5e409 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:56.060442 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-8f9dcf9f-eb2d-43dc-b3d3-8bc813d5e409 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:56.102355 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-dfd60ed9-33b8-4586-81f2-e6b766067ab0 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa0cd8ed723418daf1cbd6933e0ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0c73a5efc84e348363ae368873f51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:17:56.109753 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-dfd60ed9-33b8-4586-81f2-e6b766067ab0 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] 10.222.0.69 "GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92" status: 200 len: 1572 microversion: 2.1 time: 0.160421 May 04 19:17:56.110323 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 562/1132] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:17:55 2022] GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92 => generated 1572 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:17:56.188137 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-8f9dcf9f-eb2d-43dc-b3d3-8bc813d5e409 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8b295066bc4ae695f6e60b9b3dc5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157e9c40125e42b4b5a908fc58bfa939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:17:56.195403 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-8f9dcf9f-eb2d-43dc-b3d3-8bc813d5e409 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "GET /compute/v2.1/servers/bf80016c-70bb-49d8-8c94-1f44a76084ac" status: 200 len: 1576 microversion: 2.1 time: 0.147184 May 04 19:17:56.195971 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 571/1133] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:17:56 2022] GET /compute/v2.1/servers/bf80016c-70bb-49d8-8c94-1f44a76084ac => generated 1576 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:17:56.742525 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-d31b1748-7132-4ac7-b745-8da6d4b8d51d req-521c6c6b-bf31-4b30-abce-24204d51a91f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92be652a-42d2-4b99-9dd4-c50102203b92", "name": "network-vif-plugged", "status": "completed", "tag": "ed81644c-0d75-4430-8134-757799f98502"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:17:56.755219 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-d31b1748-7132-4ac7-b745-8da6d4b8d51d req-521c6c6b-bf31-4b30-abce-24204d51a91f service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:56.755936 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-d31b1748-7132-4ac7-b745-8da6d4b8d51d req-521c6c6b-bf31-4b30-abce-24204d51a91f service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:56.771988 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-d31b1748-7132-4ac7-b745-8da6d4b8d51d req-521c6c6b-bf31-4b30-abce-24204d51a91f service nova] Creating event network-vif-plugged:ed81644c-0d75-4430-8134-757799f98502 for instance 92be652a-42d2-4b99-9dd4-c50102203b92 on hv-cinder-83090 May 04 19:17:56.776901 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-d31b1748-7132-4ac7-b745-8da6d4b8d51d req-521c6c6b-bf31-4b30-abce-24204d51a91f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038693 May 04 19:17:56.777523 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 563/1134] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:17:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:17:57.002028 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [req-c1c64e02-1049-47ec-9f01-1a03679a92aa req-a8df15ce-6285-4867-8081-70a00b06632c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf80016c-70bb-49d8-8c94-1f44a76084ac", "name": "network-vif-deleted", "tag": "bbd412e0-d285-4a86-9b3a-addb7dfbd08b"}]} {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:17:57.010961 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-c1c64e02-1049-47ec-9f01-1a03679a92aa req-a8df15ce-6285-4867-8081-70a00b06632c service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:57.011627 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [req-c1c64e02-1049-47ec-9f01-1a03679a92aa req-a8df15ce-6285-4867-8081-70a00b06632c service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:57.024878 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.compute.server_external_events [req-c1c64e02-1049-47ec-9f01-1a03679a92aa req-a8df15ce-6285-4867-8081-70a00b06632c service nova] Creating event network-vif-deleted:bbd412e0-d285-4a86-9b3a-addb7dfbd08b for instance bf80016c-70bb-49d8-8c94-1f44a76084ac on hv-cinder-83090 May 04 19:17:57.030535 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [req-c1c64e02-1049-47ec-9f01-1a03679a92aa req-a8df15ce-6285-4867-8081-70a00b06632c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032155 May 04 19:17:57.031473 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 572/1135] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:17:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 04 19:17:57.127578 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-cb7e3c77-aca3-434b-ae46-ea129e5b95b7 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:17:57.128301 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-cb7e3c77-aca3-434b-ae46-ea129e5b95b7 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] [instance: 92be652a-42d2-4b99-9dd4-c50102203b92] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:17:57.134354 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cb7e3c77-aca3-434b-ae46-ea129e5b95b7 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:57.134794 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cb7e3c77-aca3-434b-ae46-ea129e5b95b7 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:57.135608 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cb7e3c77-aca3-434b-ae46-ea129e5b95b7 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:57.136041 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-cb7e3c77-aca3-434b-ae46-ea129e5b95b7 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:57.213090 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-95a7a315-7016-40e9-9741-cc09c4f973b4 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:17:57.213812 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-95a7a315-7016-40e9-9741-cc09c4f973b4 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: bf80016c-70bb-49d8-8c94-1f44a76084ac] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:17:57.220337 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-95a7a315-7016-40e9-9741-cc09c4f973b4 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:57.220783 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-95a7a315-7016-40e9-9741-cc09c4f973b4 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:57.221573 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-95a7a315-7016-40e9-9741-cc09c4f973b4 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:57.222016 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-95a7a315-7016-40e9-9741-cc09c4f973b4 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:57.263805 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-cb7e3c77-aca3-434b-ae46-ea129e5b95b7 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa0cd8ed723418daf1cbd6933e0ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0c73a5efc84e348363ae368873f51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:17:57.271735 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-cb7e3c77-aca3-434b-ae46-ea129e5b95b7 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] 10.222.0.69 "GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92" status: 200 len: 1572 microversion: 2.1 time: 0.148594 May 04 19:17:57.272343 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 564/1136] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:17:57 2022] GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92 => generated 1572 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:17:57.287609 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-95a7a315-7016-40e9-9741-cc09c4f973b4 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8b295066bc4ae695f6e60b9b3dc5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157e9c40125e42b4b5a908fc58bfa939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:17:57.295607 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-95a7a315-7016-40e9-9741-cc09c4f973b4 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "GET /compute/v2.1/servers/bf80016c-70bb-49d8-8c94-1f44a76084ac" status: 200 len: 1223 microversion: 2.1 time: 0.087143 May 04 19:17:57.302097 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 573/1137] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:17:57 2022] GET /compute/v2.1/servers/bf80016c-70bb-49d8-8c94-1f44a76084ac => generated 1223 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 04 19:17:58.289242 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-6b64ba56-5439-4c05-ae86-7ded8b35256b tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:17:58.289826 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-6b64ba56-5439-4c05-ae86-7ded8b35256b tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] [instance: 92be652a-42d2-4b99-9dd4-c50102203b92] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:17:58.296657 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6b64ba56-5439-4c05-ae86-7ded8b35256b tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:58.297099 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6b64ba56-5439-4c05-ae86-7ded8b35256b tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:58.297890 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6b64ba56-5439-4c05-ae86-7ded8b35256b tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:58.298319 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-6b64ba56-5439-4c05-ae86-7ded8b35256b tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:58.312914 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-5c81212b-b2c3-413e-96fe-7f6979e67d84 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:17:58.314186 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-5c81212b-b2c3-413e-96fe-7f6979e67d84 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: bf80016c-70bb-49d8-8c94-1f44a76084ac] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:17:58.320529 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5c81212b-b2c3-413e-96fe-7f6979e67d84 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:58.320985 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5c81212b-b2c3-413e-96fe-7f6979e67d84 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:58.321781 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5c81212b-b2c3-413e-96fe-7f6979e67d84 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:58.322219 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5c81212b-b2c3-413e-96fe-7f6979e67d84 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:58.354075 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5c81212b-b2c3-413e-96fe-7f6979e67d84 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:58.354526 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-5c81212b-b2c3-413e-96fe-7f6979e67d84 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:58.354982 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.objects.instance [None req-5c81212b-b2c3-413e-96fe-7f6979e67d84 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lazy-loading 'fault' on Instance uuid bf80016c-70bb-49d8-8c94-1f44a76084ac {{(pid=117124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 04 19:17:58.396462 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-5c81212b-b2c3-413e-96fe-7f6979e67d84 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8b295066bc4ae695f6e60b9b3dc5dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157e9c40125e42b4b5a908fc58bfa939', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:17:58.404814 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-5c81212b-b2c3-413e-96fe-7f6979e67d84 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "GET /compute/v2.1/servers/bf80016c-70bb-49d8-8c94-1f44a76084ac" status: 200 len: 1228 microversion: 2.1 time: 0.096483 May 04 19:17:58.405523 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 574/1138] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:17:58 2022] GET /compute/v2.1/servers/bf80016c-70bb-49d8-8c94-1f44a76084ac => generated 1228 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:17:58.435221 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-6b64ba56-5439-4c05-ae86-7ded8b35256b tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa0cd8ed723418daf1cbd6933e0ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0c73a5efc84e348363ae368873f51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:17:58.443128 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-6b64ba56-5439-4c05-ae86-7ded8b35256b tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] 10.222.0.69 "GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92" status: 200 len: 1559 microversion: 2.1 time: 0.157767 May 04 19:17:58.443861 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 565/1139] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:17:58 2022] GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:17:59.421917 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-a6894cb5-814e-4a6f-b8dd-a0b734c445cf tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:17:59.422532 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-a6894cb5-814e-4a6f-b8dd-a0b734c445cf tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: bf80016c-70bb-49d8-8c94-1f44a76084ac] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:17:59.428809 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a6894cb5-814e-4a6f-b8dd-a0b734c445cf tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:59.429261 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a6894cb5-814e-4a6f-b8dd-a0b734c445cf tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:59.430060 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a6894cb5-814e-4a6f-b8dd-a0b734c445cf tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:59.430502 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-a6894cb5-814e-4a6f-b8dd-a0b734c445cf tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:59.444204 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.wsgi [None req-a6894cb5-814e-4a6f-b8dd-a0b734c445cf tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] HTTP exception thrown: Instance bf80016c-70bb-49d8-8c94-1f44a76084ac could not be found. May 04 19:17:59.444798 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-a6894cb5-814e-4a6f-b8dd-a0b734c445cf tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Returning 404 to user: Instance bf80016c-70bb-49d8-8c94-1f44a76084ac could not be found. {{(pid=117124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 04 19:17:59.445732 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-a6894cb5-814e-4a6f-b8dd-a0b734c445cf tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "GET /compute/v2.1/servers/bf80016c-70bb-49d8-8c94-1f44a76084ac" status: 404 len: 111 microversion: 2.1 time: 0.028100 May 04 19:17:59.446297 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 575/1140] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:17:59 2022] GET /compute/v2.1/servers/bf80016c-70bb-49d8-8c94-1f44a76084ac => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 04 19:17:59.872218 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-8dc66528-5af5-423d-b5cc-aab8707659ac tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:17:59.872718 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-8dc66528-5af5-423d-b5cc-aab8707659ac tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: a8c67aa1-879c-4bd2-a133-3d8319f9494a] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:17:59.878941 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8dc66528-5af5-423d-b5cc-aab8707659ac tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:59.879387 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8dc66528-5af5-423d-b5cc-aab8707659ac tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:59.880139 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8dc66528-5af5-423d-b5cc-aab8707659ac tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:59.880568 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-8dc66528-5af5-423d-b5cc-aab8707659ac tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:59.894148 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.wsgi [None req-8dc66528-5af5-423d-b5cc-aab8707659ac tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] HTTP exception thrown: Instance a8c67aa1-879c-4bd2-a133-3d8319f9494a could not be found. May 04 19:17:59.894715 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-8dc66528-5af5-423d-b5cc-aab8707659ac tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Returning 404 to user: Instance a8c67aa1-879c-4bd2-a133-3d8319f9494a could not be found. {{(pid=117125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 04 19:17:59.895535 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-8dc66528-5af5-423d-b5cc-aab8707659ac tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "DELETE /compute/v2.1/servers/a8c67aa1-879c-4bd2-a133-3d8319f9494a" status: 404 len: 111 microversion: 2.1 time: 0.027218 May 04 19:17:59.896038 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 566/1141] 10.222.0.69 () {58 vars in 1238 bytes} [Wed May 4 19:17:59 2022] DELETE /compute/v2.1/servers/a8c67aa1-879c-4bd2-a133-3d8319f9494a => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 04 19:17:59.904768 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-4ccd487e-b59e-4997-8d87-3f53bcf1b3a3 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:17:59.905380 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-4ccd487e-b59e-4997-8d87-3f53bcf1b3a3 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] [instance: a8c67aa1-879c-4bd2-a133-3d8319f9494a] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:17:59.911120 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4ccd487e-b59e-4997-8d87-3f53bcf1b3a3 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:59.911567 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4ccd487e-b59e-4997-8d87-3f53bcf1b3a3 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:59.912326 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4ccd487e-b59e-4997-8d87-3f53bcf1b3a3 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:17:59.912756 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-4ccd487e-b59e-4997-8d87-3f53bcf1b3a3 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:17:59.925636 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.wsgi [None req-4ccd487e-b59e-4997-8d87-3f53bcf1b3a3 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] HTTP exception thrown: Instance a8c67aa1-879c-4bd2-a133-3d8319f9494a could not be found. May 04 19:17:59.926204 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-4ccd487e-b59e-4997-8d87-3f53bcf1b3a3 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Returning 404 to user: Instance a8c67aa1-879c-4bd2-a133-3d8319f9494a could not be found. {{(pid=117124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 04 19:17:59.926993 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-4ccd487e-b59e-4997-8d87-3f53bcf1b3a3 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "GET /compute/v2.1/servers/a8c67aa1-879c-4bd2-a133-3d8319f9494a" status: 404 len: 111 microversion: 2.1 time: 0.026871 May 04 19:17:59.927491 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 576/1142] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:17:59 2022] GET /compute/v2.1/servers/a8c67aa1-879c-4bd2-a133-3d8319f9494a => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 04 19:18:01.205879 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-1b359be8-218b-4c77-a297-24f72025ceb4 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] Calling method '.version_select at 0x7fc3f61e8700>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:18:01.228820 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-1b359be8-218b-4c77-a297-24f72025ceb4 tempest-TestVolumeBootPattern-794354947 tempest-TestVolumeBootPattern-794354947-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-630419074" status: 202 len: 0 microversion: 2.1 time: 0.027295 May 04 19:18:01.229399 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 567/1143] 10.222.0.69 () {58 vars in 1259 bytes} [Wed May 4 19:18:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-630419074 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 04 19:19:14.922935 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-6e59b70f-bb20-420d-b559-a02aed275e8c tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:19:14.923470 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-6e59b70f-bb20-420d-b559-a02aed275e8c tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] [instance: 92be652a-42d2-4b99-9dd4-c50102203b92] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:19:14.929589 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6e59b70f-bb20-420d-b559-a02aed275e8c tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:19:14.930138 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6e59b70f-bb20-420d-b559-a02aed275e8c tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:19:14.930785 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-d190ea7b-b0a8-4ab8-aed3-83e9c91b6bd0 req-6878f70b-0799-4fc6-aaee-65603834dec4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92be652a-42d2-4b99-9dd4-c50102203b92", "tag": "ed81644c-0d75-4430-8134-757799f98502"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:19:14.931307 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6e59b70f-bb20-420d-b559-a02aed275e8c tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:19:14.932069 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-6e59b70f-bb20-420d-b559-a02aed275e8c tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:19:14.940081 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-d190ea7b-b0a8-4ab8-aed3-83e9c91b6bd0 req-6878f70b-0799-4fc6-aaee-65603834dec4 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:19:14.940521 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-d190ea7b-b0a8-4ab8-aed3-83e9c91b6bd0 req-6878f70b-0799-4fc6-aaee-65603834dec4 service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:19:14.951422 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-d190ea7b-b0a8-4ab8-aed3-83e9c91b6bd0 req-6878f70b-0799-4fc6-aaee-65603834dec4 service nova] Creating event network-changed:ed81644c-0d75-4430-8134-757799f98502 for instance 92be652a-42d2-4b99-9dd4-c50102203b92 on hv-cinder-83090 May 04 19:19:14.956832 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-d190ea7b-b0a8-4ab8-aed3-83e9c91b6bd0 req-6878f70b-0799-4fc6-aaee-65603834dec4 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030648 May 04 19:19:14.957950 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 568/1144] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:19:14.959859 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-6e59b70f-bb20-420d-b559-a02aed275e8c tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] [instance: 92be652a-42d2-4b99-9dd4-c50102203b92] Going to try to terminate instance {{(pid=117124) delete /opt/stack/nova/nova/compute/api.py:2664}} May 04 19:19:15.043729 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-6e59b70f-bb20-420d-b559-a02aed275e8c tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] 10.222.0.69 "DELETE /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92" status: 204 len: 0 microversion: 2.1 time: 0.125389 May 04 19:19:15.044605 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 577/1145] 10.222.0.69 () {58 vars in 1238 bytes} [Wed May 4 19:19:14 2022] DELETE /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 04 19:19:15.054035 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-0ea21256-abf9-4c2e-8d64-3728aa9c3a69 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:19:15.054741 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-0ea21256-abf9-4c2e-8d64-3728aa9c3a69 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] [instance: 92be652a-42d2-4b99-9dd4-c50102203b92] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:19:15.061368 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0ea21256-abf9-4c2e-8d64-3728aa9c3a69 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:19:15.061855 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0ea21256-abf9-4c2e-8d64-3728aa9c3a69 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:19:15.062624 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0ea21256-abf9-4c2e-8d64-3728aa9c3a69 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:19:15.063059 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-0ea21256-abf9-4c2e-8d64-3728aa9c3a69 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:19:15.194695 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.policy [None req-0ea21256-abf9-4c2e-8d64-3728aa9c3a69 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa0cd8ed723418daf1cbd6933e0ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0c73a5efc84e348363ae368873f51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117125) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:19:15.202212 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-0ea21256-abf9-4c2e-8d64-3728aa9c3a69 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] 10.222.0.69 "GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92" status: 200 len: 1565 microversion: 2.1 time: 0.153034 May 04 19:19:15.202776 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 569/1146] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:19:15 2022] GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92 => generated 1565 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:19:16.220184 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-314ad6ab-f9f6-4bc4-ab46-bce71b7182e4 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:19:16.220877 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-314ad6ab-f9f6-4bc4-ab46-bce71b7182e4 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] [instance: 92be652a-42d2-4b99-9dd4-c50102203b92] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:19:16.227410 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-314ad6ab-f9f6-4bc4-ab46-bce71b7182e4 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:19:16.227856 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-314ad6ab-f9f6-4bc4-ab46-bce71b7182e4 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:19:16.228609 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-314ad6ab-f9f6-4bc4-ab46-bce71b7182e4 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:19:16.229040 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-314ad6ab-f9f6-4bc4-ab46-bce71b7182e4 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:19:16.424092 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-314ad6ab-f9f6-4bc4-ab46-bce71b7182e4 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa0cd8ed723418daf1cbd6933e0ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0c73a5efc84e348363ae368873f51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:19:16.432072 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-314ad6ab-f9f6-4bc4-ab46-bce71b7182e4 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] 10.222.0.69 "GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92" status: 200 len: 1565 microversion: 2.1 time: 0.215667 May 04 19:19:16.432589 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 578/1147] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:19:16 2022] GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92 => generated 1565 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:19:17.278066 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [req-4ca7b2b5-a625-40f0-a22e-b9c4a92044a1 req-d39e39e4-806e-4844-b3f6-21c5e7c9874b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92be652a-42d2-4b99-9dd4-c50102203b92", "name": "network-vif-deleted", "tag": "ed81644c-0d75-4430-8134-757799f98502"}]} {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 04 19:19:17.286419 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-4ca7b2b5-a625-40f0-a22e-b9c4a92044a1 req-d39e39e4-806e-4844-b3f6-21c5e7c9874b service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:19:17.286860 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [req-4ca7b2b5-a625-40f0-a22e-b9c4a92044a1 req-d39e39e4-806e-4844-b3f6-21c5e7c9874b service nova] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:19:17.297838 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.compute.server_external_events [req-4ca7b2b5-a625-40f0-a22e-b9c4a92044a1 req-d39e39e4-806e-4844-b3f6-21c5e7c9874b service nova] Creating event network-vif-deleted:ed81644c-0d75-4430-8134-757799f98502 for instance 92be652a-42d2-4b99-9dd4-c50102203b92 on hv-cinder-83090 May 04 19:19:17.303080 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [req-4ca7b2b5-a625-40f0-a22e-b9c4a92044a1 req-d39e39e4-806e-4844-b3f6-21c5e7c9874b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029061 May 04 19:19:17.304323 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 570/1148] 10.222.0.69 () {64 vars in 1317 bytes} [Wed May 4 19:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 04 19:19:17.451576 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-74339e84-7448-42f0-9de8-0004cf263748 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Calling method '>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:19:17.452125 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.compute.api [None req-74339e84-7448-42f0-9de8-0004cf263748 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] [instance: 92be652a-42d2-4b99-9dd4-c50102203b92] Fetching instance by UUID {{(pid=117124) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:19:17.458473 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-74339e84-7448-42f0-9de8-0004cf263748 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:19:17.458927 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-74339e84-7448-42f0-9de8-0004cf263748 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:19:17.459696 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-74339e84-7448-42f0-9de8-0004cf263748 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:19:17.460140 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG oslo_concurrency.lockutils [None req-74339e84-7448-42f0-9de8-0004cf263748 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:19:17.519651 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.policy [None req-74339e84-7448-42f0-9de8-0004cf263748 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa0cd8ed723418daf1cbd6933e0ce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0c73a5efc84e348363ae368873f51d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117124) authorize /opt/stack/nova/nova/policy.py:199}} May 04 19:19:17.527200 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-74339e84-7448-42f0-9de8-0004cf263748 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] 10.222.0.69 "GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92" status: 200 len: 1217 microversion: 2.1 time: 0.081629 May 04 19:19:17.527769 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 579/1149] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:19:17 2022] GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92 => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 04 19:19:18.821262 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-26b2d2a9-dff5-467a-bcbc-59e5f6877526 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Calling method '>' {{(pid=117125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:19:18.822521 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.compute.api [None req-26b2d2a9-dff5-467a-bcbc-59e5f6877526 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] [instance: 92be652a-42d2-4b99-9dd4-c50102203b92] Fetching instance by UUID {{(pid=117125) get /opt/stack/nova/nova/compute/api.py:2918}} May 04 19:19:18.828416 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-26b2d2a9-dff5-467a-bcbc-59e5f6877526 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:19:18.828861 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-26b2d2a9-dff5-467a-bcbc-59e5f6877526 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:19:18.829641 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-26b2d2a9-dff5-467a-bcbc-59e5f6877526 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 04 19:19:18.830074 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG oslo_concurrency.lockutils [None req-26b2d2a9-dff5-467a-bcbc-59e5f6877526 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Lock "86210640-9976-41e4-9a2e-686dd20f0fdb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 04 19:19:18.843487 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.wsgi [None req-26b2d2a9-dff5-467a-bcbc-59e5f6877526 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] HTTP exception thrown: Instance 92be652a-42d2-4b99-9dd4-c50102203b92 could not be found. May 04 19:19:18.844054 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: DEBUG nova.api.openstack.wsgi [None req-26b2d2a9-dff5-467a-bcbc-59e5f6877526 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Returning 404 to user: Instance 92be652a-42d2-4b99-9dd4-c50102203b92 could not be found. {{(pid=117125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 04 19:19:18.844845 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO nova.api.openstack.requestlog [None req-26b2d2a9-dff5-467a-bcbc-59e5f6877526 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] 10.222.0.69 "GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92" status: 404 len: 111 microversion: 2.1 time: 0.304600 May 04 19:19:18.845357 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: [pid: 117125|app: 0|req: 571/1150] 10.222.0.69 () {58 vars in 1235 bytes} [Wed May 4 19:19:18 2022] GET /compute/v2.1/servers/92be652a-42d2-4b99-9dd4-c50102203b92 => generated 111 bytes in 306 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 04 19:19:19.002704 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: DEBUG nova.api.openstack.wsgi [None req-c001d6ea-925d-4814-9fe5-7b52be595287 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] Calling method '.version_select at 0x7fc3f640f310>' {{(pid=117124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 04 19:19:19.020660 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO nova.api.openstack.requestlog [None req-c001d6ea-925d-4814-9fe5-7b52be595287 tempest-TestShelveInstance-1934180687 tempest-TestShelveInstance-1934180687-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-97506937" status: 202 len: 0 microversion: 2.1 time: 0.021882 May 04 19:19:19.021240 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: [pid: 117124|app: 0|req: 580/1151] 10.222.0.69 () {58 vars in 1247 bytes} [Wed May 4 19:19:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-97506937 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 04 19:20:49.318727 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 04 19:20:49.318727 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: Wed May 4 19:20:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 04 19:20:52.010082 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 04 19:20:52.010611 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: Wed May 4 19:20:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 04 19:21:14.785206 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 04 19:21:14.785809 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: Wed May 4 19:21:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 04 19:21:20.573221 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 04 19:21:20.573874 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: Wed May 4 19:21:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 04 19:21:39.073902 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 04 19:21:39.074538 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: Wed May 4 19:21:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 04 19:21:42.063088 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 04 19:21:42.063603 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: Wed May 4 19:21:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 04 19:24:09.327015 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 04 19:24:09.327674 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: Wed May 4 19:24:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 04 19:24:12.019235 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 04 19:24:12.019671 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: Wed May 4 19:24:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 04 19:24:34.793932 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 04 19:24:34.794567 dv-cinder-830901-3-iscsi devstack@n-api.service[117125]: Wed May 4 19:24:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 04 19:24:40.581099 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 04 19:24:40.581702 dv-cinder-830901-3-iscsi devstack@n-api.service[117124]: Wed May 4 19:24:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!